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Module 4 


Route Selection Using 
Attributes 


Overview 


Routes learned via Border Gateway Protocol (BGP) have properties that are associated with 
them that aid a router in determining the best route to a destination when multiple paths to that 
particular destination exist. These properties are referred to as BGP attributes. This module 
introduces the role of BGP attributes, and explains how their presence influences route 
selection in BGP. Understanding how BGP attributes influence route selection is required for 
the design of robust networks. 


This module provides advanced information on how to connect Internet customers to multiple 
service providers. It includes an in-depth description of BGP attributes that are used in route 
selection, including weight, local preference, AS-path prepending, multi-exit discriminator 
(MED), and BGP communities. 
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Module Objectives 


Upon completing this module, you will be able to describe the BGP attributes that are used in 
route selection. 


Module Objectives 


Successfully configure BGP to influence route selection by 
using the weight attribute in a customer scenario where you 
must support multiple connections 


Use the local preference attribute to influence route selection 
in a customer scenario where you must support multiple 
connections 


Use AS-path prepending to influence the return path that is 
selected by the neighboring autonomous systems ina 
customer scenario where you must support multiple 
connections 


Use the MED attribute to influence route selection ina 
customer scenario where you must support multiple 
connections 


Use BGP community attributes to influence route selection 
in a customer scenario where you must support multiple 
connections 


Module Outline 


The outline lists the components of this module. 


Module Outline 


° Influencing BGP Route Selection with Weights 
° Setting the BGP Local Preferences 
¢ Using AS-Path Prepending 


¢ Understanding the BGP Multi-Exit Discriminator 


* Addressing BGP Communities 
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Influencing BGP Route 
selection with Weights 


Overview 


This lesson discusses how to influence BGP route selection by setting the weight attribute of 
incoming BGP routes. Two methods that are used to set the weight attribute are discussed in 
this lesson as follows: default weight, and route-maps. This lesson also explains how to monitor 
the BGP table to verify correct weight configuration and properly influence path selection. 


Relevance 


When connections to multiple providers are required, it is important that BGP select the 
optimum route for traffic to use. The “optimum” or “best” route may not be what the network 
designer intended based on design criteria, administrative policies, or corporate mandate. 
Fortunately, BGP provides many tools for administrators to influence route selection. One of 
these tools is the weight attribute. 


Objectives 


Upon completing this lesson, you will be able to influence route selection by using the weight 
attribute. This includes being able to meet these objectives: 


m= List BGP route selection criteria 

m™ Describe the use of BGP weights to influence the BGP route selection process 

m Influence the BGP route selection process by configuring per-neighbor weights 

m Influence the BGP route selection process by configuring BGP weights with route-maps 


m Identify the Cisco IOS commands that are required to monitor BGP route selection 
and weights 


= Summarize BGP route selection and filtering tools 
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Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
— eS ci] 
° Overview 
e BGP Route Selection Criteria 
° Influencing BGP Route Selection 


¢ Configuring Per-Neighbor Weights 


¢ Changing Weights with Route-Maps 
* Monitoring BGP Route Selection and Weights 


° BGP Route Selection and Filtering Tools 
Summary 


° Summary 
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BGP Route Selection Criteria 


This topic lists the different criteria that are used by BGP for best-path route selection. 


BGP Route Selection Criteria 


° Prefer highest weight (local to router) 

° Prefer highest local preference (global within AS) 
° Prefer routes that the router originated 

¢ Prefer shorter AS paths (only length is compared) 


° Prefer lowest origin code (IGP < EGP < Incomplete) 
¢ Prefer lowest MED 


* Prefer external (EBGP) paths over internal (IBGP) 


* For IBGP paths, prefer path through closest IGP 
neighbor 


¢ For EBGP paths, prefer oldest (most stable) path 
° Prefer paths from router with the lower BGP router-ID 


BGP v3.1—4-3 


BGP route selection criteria take the weight parameter into consideration first. If a router has 
two alternative paths to the same destination, and their weight values are different, BGP selects 
the route with the highest weight value as the best. Only when the two alternatives have equal 
weight is the next criterion, local preference, checked. 


A high local preference value is preferred before a low value. Only when the two alternatives 
have an equal local preference is the next criterion checked. 
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Influencing BGP Route Selection 


This topic describes how network administrators can use BGP weights to influence the BGP 
route selection process. 


Influencing BGP Route Selection 


BGP routing policy can be specified by using: 


* Weights: provides local routing policy (within a 
router) 


¢ Local preference: provides AS-wide routing policy 
BGP weights are specified per neighbor. 

* Default weight 

* AS-path-based weight 

¢ Complex criteria with route-maps 


BGP v3.1—4-4 


The weight attribute is local to a single router only. The weight value is never propagated by 
the BGP protocol. It constitutes a routing policy local to the router. 


Local preference is assigned to a route as an attribute. It is carried with the route on all internal 
BGP sessions. This situation means that all other BGP-speaking routers within the autonomous 
system (AS) receive the same information. Normally, a router assigns a local preference to a 
route when it is received on an external BGP session, before it is accepted and entered in the 
BGP table of the border router. Routers propagate the local preference attribute on internal 
BGP sessions only. This policy constitutes a routing policy for the entire AS. 


The router can assign the weight attribute to a route in two ways: 


m= All routes that are received from a specific neighbor can be assigned a default weight value. 
This weight value indicates that the neighbor is more preferred than the other neighbors. 


m= A route-map that is applied on incoming routes from a neighbor can be used to select some 
routes and assign them weight values. Remember that a route-map also acts as a filter and 
will silently drop those routes that are not permitted by any statement in the route-map. 


If configured, the default weight assignment on routes that are received from a neighbor is 
applied first. All routes that are received from the neighbor are assigned a weight value as 
defined by the default weight. 
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Secondly, a route-map is applied, if it is configured on the router. The route-map can be 
arbitrarily complex and select routes based on various selection criteria, such as a network 
number or AS path. The selected routes can have some attributes altered. The route-map can set 
the weight values of permitted routes. Selection can be done in several route-map statements, 
giving the opportunity to assign a certain weight value to some routes and another weight value 
to others. A route-map can also completely filter out routes. 
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Configuring Per-Neighbor Weights 


This topic describes how to influence the BGP route selection process by configuring per- 
neighbor weights. 


Configuring Per-Neighbor Welgite 


router (config-router) # 


neighbor ip-address weight weight 


° All routes from the BGP neighbor get the 
specified weight. 


° BGP routes with higher weight are preferred. 
° Weight is applied only to new incoming updates. 


° To enforce new weights, re-establish BGP 
sessions with your neighbors by using clear ip 
bgp command. 


neighbor weight 


To assign a weight to a neighbor connection, use the neighbor weight router configuration 
command. 


m neighbor {ip-address | peer-group-name} weight weight 


To remove a weight assignment, use the no form of this command. 


= no neighbor {ip-address | peer-group-name} weight weight 


Syntax Description 


Parameter Description 

ip-address IP address of neighbor. 

peer-group-name Name of a BGP peer group. 

weight Weight to assign. Acceptable values are 0 to 65535. 


All routes that are received from the neighbor after the configuration line is in place are 
assigned the weight value. To make sure that all routes from the neighbor receive the new 
weight value, you can restart the BGP session, thus forcing the neighbor to resend all routes. 


If no weight value is specified, the default value of 0 is applied. 
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Restarting of BGP sessions might be necessary after making a configuration change in the 
routing policy. The configuration change itself will not alter the already-received routes. The 
clear ip bgp EXEC command tears down the BGP session, and the session automatically 
restarts. 


Example 


Configuring Per-Neighbor Weights (Cont.) 


Another 
Customer Upstream AS 


Multi-homed 
Customer 


Primary 
_ Primary ISP 


router bgp Customer-AS 
neighbor Primary-ISP weight 150 
neighbor Backup-ISP weight 100 


Routes received from primary ISP should be preferred 
over routes received from backup ISP. 
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In this example, the multihomed customer would like to use the primary link to the primary 
Internet service provider (ISP) for all destinations. The weight is configured by the customer on 
both BGP sessions, giving a higher weight to those routes that are received from the primary 
ISP compared to those that are received from the backup ISP. 


Any time that the multihomed customer receives routing information about the same IP 
network number from both the ISPs, the customer compares the weights assigned to the routes. 
Those received from the primary ISP will always win this comparison. The multihomed 
customer sends the outgoing IP packets to the destination network via the primary ISP 
regardless of the other BGP attributes that are assigned to both alternatives. 


Consequently, the other customer that is directly connected to the backup ISP will also be 
reached via the primary ISP. 
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Configuring Per-Neighbor Weights (Cont) 


Customer# show ip bgp 

BGP table version is 16, local router ID is 1.2.3.4 

Status codes: s suppressed, h history, * valid, > best, i - internal 
Origin codes: i - IGP, e - EGP, ? - incomplete 


Network Next Hop Metric LocPrf Weight Path 

eo 20.0.0 0.0. ie) 32768 i 

*> 21.0.0.0 150:.3721.3 

* (e) 100 21 2 

(e) 150°37 3: 
100.21 37 4 

ie) 150 37 40 
100 21 40 i 


*> 37.0.0.0 
* 


Loboeoo 


*> 40.0.0.0 
* 
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In this example, the multihomed customer has received routes to three different class A 
networks outside of its own AS (network 21.0.0.0/8, network 37.0.0.0/8, and network 
40.0.0.0/8). The customer has received all three routes from both the primary ISP and the 
backup ISP. 


When the routes were received from the primary ISP, the weight value 150 was assigned to 
each of the routes. When the routes were received from the backup ISP, the weight value 100 
was assigned to each of the routes. 


The customer router now makes the route selection. It has two alternative paths for each 
destination network. For each of them, the router selects the path via the primary ISP as the 
best. It makes this selection regardless of other BGP attributes, such as AS-path length. 


The network 21.0.0.0/8 is reached via the primary ISP although it is actually a network in the 
AS of the backup ISP (AS 21). 


The class A network 1.0.0.0/8 in this example is injected into the BGP table by this router. By 
default, locally sourced routes are assigned a weight of 32768. 
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Changing Weights with Route-Maps 


This topic describes how to influence the BGP route selection process by configuring BGP 
weights with route-maps. 


Changing Weights with Route-Maps 


¢ Weights can be set with route-maps in complex 
scenarios. 


* Routes can be matched on any combination of 
prefix-lists, AS-path filters, or other BGP 
attributes. 


* Routes not matched by the route-map are 
discarded. 


router bgp as-number 

neighbor ip-address route-map route-map-name in 
! 
route-map route-map-name permit sequence 

match condition 

set weight weight 


The route-map is a powerful tool to select and alter routing information. When a route-map is 
applied to incoming information from a BGP neighbor, each received update is examined as it 
passes through the route-map. Statements in the route-map are executed in the order that is 
specified by their sequence numbers. 


The first statement in the route-map for which all the match clauses indicate a match is the one 
that is used. If the route-map says “permit,” the set clauses are applied to the route, the route is 
accepted, and the weight is changed. 


Match clauses can be arbitrarily complex. One of them can refer to an AS-path access-list that 
does matching on AS paths. Another can refer to a prefix-list that does matching on the 
announced network number. Only when all configured match clauses are evaluated is the route- 
map statement used and its result, “permit” or “deny,” applied. 


If a received route is not matched by any of the route-map statements, and the end of the route- 
map is reached, the route-map logic has an “implicit deny” rule. This rule means that if no 
statement selects a route, the route is discarded. 


If the “implicit deny” rule is not desired, an “explicit permit all” at the end of the route-map can 
overrule it. To ensure that such a route-map statement is the last statement, you should assign it 
a very high sequence number. It should not have any match clause at all. The lack of a match 
clause means, “match all.” By not configuring any set clause, you can ensure that no attributes 
are altered by the statement. 
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Example 


Changing Weights with Route: Maps (Cont) 


Set weight 200 to networks coming from 2.3.4.5 
originated in AS 21 


router bgp 123 

neighbor 2.3.4.5 route-map w200 in 
! 

route-map w200 permit 10 

match as-path 47 

set weight 200 

! 


route-map w200 permit 20 
set weight 100 
! 


ip as-path access-list 47 permit _21$ 


002G_047 
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This is an example of a route-map that sets the weight value to each route that it receives from a 
neighbor. 


All received routes have their AS paths checked against the AS-path access-list 47. Those 
routes with an AS path that indicates that they originated in AS 21 are permitted by the AS-path 
access-list 47 as referenced by route-map statement number 10. Routes that are permitted and 
selected by route-map statement number 10 in the w200 route-map will have their weight set to 
200 as indicated by the set clause in the route-map. 


The routes that are not originated in AS 21 (routes that are not permitted by AS-path access-list 
47) are then tested by route-map statement number 20. This statement does not include a match 
clause, indicating that all routes are matched. Therefore, all routes that are not matched by 
route-map statement 10 are matched by route-map statement 20. The route-map has been 
configured with an “explicit permit all” statement at the end of the route-map. 


Routes that are matched by route-map statement 20 have their weight set to 100. The result is 
that the routes that originated in AS 21 are accepted by the router and assigned the weight 200. 
All others are accepted and assigned the weight value 100. No route is discarded by this route- 


Map. 
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Note Specifying weights with filter-lists is no longer supported in Cisco IOS Release 12.1, and the 
command has already been removed from Cisco IOS Release 12.1T. These releases use 
an incoming route-map, where you match an AS path with the match as-path command 
and set the weight with the set weight command. When you are using a route-map as a 
replacement for the filter-list with the weight option, make sure that specifying a “permit” 
entry in the route-map without an associated match condition does not filter all other routes. 
Using route-maps as a weight-setting mechanism is explained later in this lesson. 
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Monitoring BGP Route Selection and Weights 


This topic lists the Cisco IOS commands that are required to monitor BGP route selection and 
weights. 


Monitoring BGP Route 
Selection and Weights 


router> 


show ip bgp 


* Displays all BGP routes; best routes are marked with 
“>”: weight associated with every route is displayed 


router> 


show ip bgp ip-prefix [mask subnet-mask] 


* Displays detailed information about all paths fora 
single prefix 
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show ip bgp 
To display entries in the BGP routing table, use the show ip bgp EXEC command. 


show ip bgp [network] [network-mask] [longer-prefixes] 


Syntax Description 


Parameter Description 

network (Optional) Network number that is entered to display a particular 
network in the BGP routing table 

network-mask (Optional) Displays all BGP routes that match the address-mask 
pair 

longer-prefixes (Optional) Displays a route and its more specific routes 


Without any argument, the show ip bgp command displays the entire BGP table. The routes 
that are selected as the best are indicated by the “>” character. 


To get more detailed information about routes to a specific destination network, you can use the 
network number, and optionally the subnet mask, as an argument on the command line. These 
additions will display more detailed information about that specific network. 
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Example 


Monitoring BGP Route 
Selection and Weights (Cont.) 


router> show ip bgp 

BGP table version is 11, local router ID is 12.1.2.3 

Status codes: s suppressed, d damped, h history, * valid, > best, i - internal 
Origin codes: i - IGP, e - EGP, ? - incomplete 


Network Next Hop Metric LocPrf Weight Path 
*> 10.0.0.0 1.2.0.5 500 woos 37 213 i 
* 1000 0 213 i 


*> 11.0.0.0 12.0. 500 100 37 48 i 
* 0 


-1.0. 1000 213 48 i 
*> 12.0.0.0 0.0. fe) 32768 i 
*> 14.0.0.0 -1.0. ie} 0 387 i 
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The show ip bgp command provides a printout of all routes in the BGP table. Each route is 
displayed on one line. This one-line limitation means that more detailed information about the 
route cannot be displayed because of lack of space. 


The network number is displayed, and if the subnet mask differs from the natural mask, the 
prefix length is indicated. The BGP next-hop attribute, MED (metric), local preference, weight, 
AS-path, and origin code are displayed on the line. Local preference is displayed only if it is 
not the default value. 


The printout is sorted in network number order. If there is more than one route to the same 
network, the network number is printed on the first line only. The other routes to the same 
network have their network field left blank on the output. 


Routes that are selected as the best to reach a certain destination network are indicated by the 
“>” character. 


In this example, weight has been used to prefer routes received from the neighbor in AS 37. 
Therefore, although the AS path is shorter via AS 213, the class A network 10.0.0.0/8 is 
reached via AS 37 (because the weight is higher). 


Network 12.0.0.0 has two routes with the self-originated path selected as best. self-originated 
result in the next hop address of 0.0.0.0 and a weight of 32768. 


Information about network 14.0.0.0/8 is received only from the neighbor in AS 387. As there is 
no alternative, the route is selected as best. 
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4-16 


Monitoring BGP Route 
Selection and Weights (Cont.) 


router> show ip bgp 11.0.0.0 
BGP routing table entry for 11.0.0.0/8, version 5 
Paths: (2 available, best #1, advertised over EBGP) 
213 
12.021, from 152,021 (10.12.11) 
Origin IGP, metric 500, localpref 100, valid, external, best 
213 
1.0.1 from- 2 130.015 (11-070 . 2B) 
Origin IGP, metric 1000, localpref 100, valid, external 
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The show ip bgp command with network number as argument displays more detailed 
information about that network only. First, a short summary that indicates the network number 
and prefix length is displayed along with the table version number for this route. The next line 
indicates how many alternative routes have been received, and which one of them has been 
selected by the router as the best. 


Next, there are a couple of lines for each of the received routes to reach the network. For each 
of the routes, all attributes are displayed. The one selected as the best also has the word “best” 
displayed. 


In this example, there are two alternatives to reach network 11.0.0.0/8. Each of them is received 
from different neighbors in AS 213. The network 11.0.0.0 is created in AS 213. 


The route selection mechanism has selected the first route that is listed as the best. It was 
chosen because the MED (metric) value is lower. 


Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


BGP Route Selection and Filtering Tools 
Summary 


This topic presents a summary of all BGP filtering tools in the order they are applied. 


BGP Route Selection and 
Filtering Tools Summary 


Incoming neighbor 


prefix-list out 
filter-list in filter-list out 
IGP 
default weight (OSPF, EIGRP) route-map out 


(filters, ...) 
filter-list weight 


route-map in 
(filters, weights) 


distribute-list out 


route-map in 
(filters, weights) 


My router 


The figure shows all the possible applications of prefix-lists, filter-lists, weights, and route- 
maps. They are applied in the order indicated. 


Prefix-lists and filter-lists, both in and out, filter out routes and discard those that are not 
permitted. Weight setting is applicable only on incoming routes because a router never 
propagates the weight attribute to its neighbors. Route-maps can be filters that discard routes 
but can also be used to modify and set various attributes on both incoming and outgoing routes. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
ee  eiseone | 


¢ One of the most commonly used ways of 
influencing BGP path selection is with weights. 
Weights are the first criterion in BGP route 
selection. 


° Changing weights is an operation that applies 
only to the local router and is lost when the 
BGP update is propagated to other BGP 
neighbors. 


* You can use the neighbor weight command to 
assign a weight value to all routes that are 
received from a neighbor. 


Summary (Cont.) 


¢ Route-maps can be applied to neighbors to set 
the weight attribute of received routes. 


¢ You can use the show ip bgp command to 
display all bgp routes, the routes that are 
selected by BGP as “best,” and the weight 
attribute setting for each route. 


° The weight attribute setting is applicable only 
on incoming routes because weight is never 
propagated to other neighbors. 
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References 


For additional information, refer to these resources: 


m= For information on the weight attribute, refer to “Border Gateway Protocol” at the 
following URL: http://www.cisco.com/univercd/cc/td/doc/cisintwk/ito_doc/bgp.htm 


m= For further information on the weight attribute, refer to “Configuring BGP” at the 
following URL: 
http://www.cisco.com/univercd/cc/td/doc/product/software/ios122/122cgcr/fipr_c/ipcprt2/1 
cfbgp.htm#xtocid15 


Next Steps 


For the associated lab exercise, refer to the following section of the course Lab Guide: 


m Lab Exercise 4-1: Influencing BGP Route Selection with Weights 
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setting BGP Local Preference 


Overview 


This lesson discusses how to influence BGP route selection by setting the BGP local preference 
attribute of incoming BGP routes. Local preference is similar to the weight attribute but differs 
from the BGP weight attribute in that weight is local to a specific router on which it is 
configured. Two methods that are used to set the local preference attribute are discussed in this 
lesson: default local preference and route-maps. This lesson also explains how to monitor the 
BGP table to verify correct local preference configuration and to properly influence path 
selection. 


Relevance 


When connections to multiple providers are required, it is important that BGP select the 
optimum route for traffic to use. The optimum, or best, route may not be what the network 
designer intended based on design criteria, administrative policies, or corporate mandate. 
Fortunately, BGP provides many tools for administrators to influence route selection. One of 
these tools is the local preference attribute. 


Objectives 


Upon completing this lesson, you will be able to influence route selection by using the local 
preference attribute. This includes being able to meet these objectives: 


m Explain why using BGP weights might not provide consistent BGP route selection in an AS 
m Describe how the BGP local preference attribute influences BGP route selection 


m Identify the Cisco IOS command that is required to configure default BGP local preference 
on a router 


m Identify the Cisco IOS commands that are required to configure BGP local preference 
using route-maps 


m= Identify the Cisco IOS commands that are required to monitor BGP local preference 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m™ Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 
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Outline 


The outline lists the topics included in this lesson. 


Outline 
EO — (Cisco.com 


° Overview 

* Consistent Route Selection Within the AS 
° BGP Local Preference 

¢ Configuring Default Local Preference 


¢ Configuring Local Preference with 
Route-Maps 


° Monitoring Local Preference 


° Summary 
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Consistent Route Selection Within the AS 


This topic explains why using BGP weights might not provide consistent BGP route selection 
inside an AS. 


Consistent Route Selection 
Within the AS 


Desired traffic flow 


Default traffic flow 


Q1: Which routing protocol must be run in AS 213 ? 
A1: You must run IBGP in AS 213. 
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Using BGP in autonomous systems with a single neighbor relationship usually does not require 
any advanced features. In situations like the one shown in the figure, however, it is important to 
ensure that customer routers choose the correct link. Obviously, the router should choose the 2- 
Mbps link and use the 64-kbps link only for backup purposes. 


To make sure that the router selects the upper link (2-Mbps link) as its primary link, and has the 
ability to switch over to the backup if a failure occurs, you must configure an Internal Border 
Gateway Protocol (IBGP) session between the two border routers in AS 213. 
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Consistent Route Selection 
Within the AS (Cont.) 


Desired traffic flow 


x 
8 
bal 
9g 
g 
3 


Default traffic flow 


Q2: How will you influence the route selection on routers 
in AS 213 so that they select the fastest route? 
A2: By using weights on EBGP and IBGP sessions. 
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One way of changing the default route selection is to use weights. Weight is an attribute that is 
locally significant to a router. It is a property, or parameter, and is, therefore, not seen on any 
neighboring routers. When designing BGP networks using weights, network administrators 
should set the weights on every router. If there is more than one path for the same network, a 
router will choose the one with the highest weight. The default value for weight is 0. 


In this example, the upper router in AS 213 sets a weight of 100 for routes that are received 
over the 2-Mbps link from AS 462 (primary link) and prefers them to possible internal updates 
from the bottom router, where the default weight is 0. The bottom router sets a weight of 100 
for internal routes that are received from the upper router and prefers them to routes that are 
received from AS 387. As a result, all packets will leave the AS through the primary 2-Mbps 


link. 
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Consistent Route Selection 
Within the AS (Cont.) 


router bgp 213 

neighbor 1.2.3.4 remote-as 462 
neighbor 1.2.3.4 weight 100 
neighbor 5.6.7.8 remote-as 213 


| _—_—s«x(Deessired traffic flow 


router bgp 213 

neighbor 5.6.7.9 remote-as 213 
neighbor 5.6.7.9 weight 100 
neighbor 7.8.9.10 remote-as 387 


0026_053 
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The configurations that are shown in the figure demonstrate how to change the default weight 
on a per-neighbor basis. If you use the neighbor weight command, all newly arrived updates 
will have a weight of 100. Updates coming from the other neighbor will still have the default 
weight of 0. 


After you have applied the neighbor weight command, a refresh is needed from the neighbor. 
There are three ways of doing this, depending on the Cisco IOS version: 


m= Use clear ip bgp neighbor address to clear the neighbor relationship and re-establish it to 
refresh the BGP entries and apply the weight. 


™ Configure soft reconfiguration for the neighbor and use the clear command. You can 
perform all subsequent clearing by using clear ip bgp neighbor address soft in, which 
does not reset the neighbor relationship. The soft reconfiguration feature is supported by 
Cisco starting with IOS version 11.2. 


m= Use clear ip bgp neighbor address in if both neighboring routers support the route 
refresh. The route refresh feature is available from Cisco starting with IOS version 12.1. 


See the module “Route Selection Using Policy Controls” for a detailed description of the 
commands here. 
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Example 


Consistent Route Selection 
Within the AS (Cont.) 


Desired traffic flow 


Internet 


Default traffic flow 
Have the traffic run over the fastest line available 
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This example is more complex. When you are trying to implement this example with weights, it 
requires two route-maps on each router within AS 213. Luckily, BGP has a similar mechanism 
that you can use for consistent AS-wide route selection: local preference. 
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BGP Local Preference 


This topic describes how the BGP local preference attribute influences BGP route selection. 


BGP Local Preference 


¢ You can use local preference to ensure AS- 
wide route selection policy. 


¢ Any BGP router can set local preference when 
processing incoming route updates, when 
doing redistribution, or when sending outgoing 


route updates. 


* Local preference is used to select routes with 
equal weight. 


* Local preference is stripped in outgoing EBGP 
updates except in EBGP updates with 
confederation peers. 


Local preference is similar to weight; because it is an attribute, you can set it once and then 
view it on neighboring routers without having to reset it. This attribute has a default value of 
100, which the router will apply to locally originated routes and updates that come in from 
external neighbors. Updates that come from internal neighbors already have the local 
preference attribute. 


Local preference is the second strongest criteria in the route selection process. If there are two 
or more paths available for the same network, a router will first compare weight, and if the 
weights are equal for all paths, the router will then compare the local preference attributes. The 
path with the highest local preference value is preferred. 


The local preference attribute is automatically stripped out of outgoing updates to External 
Border Gateway Protocol (EBGP) sessions. This fact means that you can use this attribute only 
within a single AS to influence the route selection process. 
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BGP Local Preference (Cont.) 
——————————————— re een mars SIN eneT eet 


Local preference is the second strongest BGP 
route selection parameter. 


Remember the BGP route selection rules: 
¢ Prefer highest weight (local to router) 


¢ Prefer highest local preference (global within AS) 
¢ Other BGP route selection rules 


Weights configured on a router override local 
preference settings. 


To ensure consistent AS-wide route selection: 
* Do not change local preference within the AS. 
* Do not use BGP weights. 


Local preference is the second strongest BGP route selection parameter. Remember the route 
selection rules: 


1. Prefer highest weight (local to router) 
2. Prefer highest local preference (global within AS) 


3. Process all remaining BGP route selection rules 


Because network administrators can use both weight and local preference to manipulate the 
route selection process, they must decide which one to use. If local preference is used, the 
weight should be the same for all paths. 


Network administrators can use weight on an individual router to override local preference 
settings that are used in the rest of the AS. 


In most cases, it is enough to change the default local preference on updates coming from 
external neighbors. Network administrators should avoid changing the local preference attribute 
on internal sessions to prevent unnecessary complexity and unpredictable behavior. 
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BGP Local Preference (Cont.) 


Per-router Local preference can Local 
default local be modified with a preference 
preference set route-map is removed 


External External 
BGP peer BGP table BGP peer 


Intraconfederation Intraconfederation 
EBGP peer EBGP peer 


Local preference can 
be modified with a 
route-map 


Internal My router Internal 
BGP peer y BGP peer 
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Network administrators can apply local preference in the following ways: 


m Using aroute-map with the set local-preference command. You can use the route-map on 
incoming updates from all neighbors or on outgoing updates to internal neighbors (not 
recommended). 


m= Using the bgp default local-preference command to change the default local preference 
value that is applied to all updates that come from external neighbors or that originate 


locally. 
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Configuring Default Local Preference 


This topic lists the Cisco IOS command that is required to configure default BGP local 
preference on a Cisco router. 


Configuring Default Local Preference 


router (config-router) # 


bgp default local-preference preference 


* Changes the default local preference value. 


° The specified value is applied to all routes that do not 
have local preference set (EBGP routes). 


° The default value of this parameter is 100, allowing 
you to specify more desirable or less desirable 
routers. 
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You can use the bgp default local-preference command in BGP configuration mode to change 
the default value of local preference. The new default value applies only to locally originated 
routes and those that are received from external neighbors. 


Setting a value lower than the default of 100 will result in the router preferring internal paths to 
external (normally a router would prefer external routes). 


Setting a value higher than 100 will result in external paths being preferred to all internal paths 
(also those with a shorter AS path). 
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Example 


Configuring Default Local 
Preference (Cont.) 


RTR-A# 
router bgp 213 
bgp default local-preference 120 


| _—«x|Desired traffic flow 


|__| Default traffic flow 


router bgp 213 
bgp default local-preference 50 
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In this example, the local preference attribute is used instead of weights. The two indicated 
routers in AS 213 have different default local preference values that are applied to external 
updates. The bottom router receives updates from the external neighbor and applies local 
preference to them. The same router then receives updates from the upper router, which set a 
local preference of 120 to all external updates. The bottom router then compares all paths and, 
where two paths exist, chooses the one with the higher local preference (120). 
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Configuring Local Preference with Route-Maps 


This topic lists the Cisco IOS commands that are required to configure BGP local preference 
with route-map statements. 


Configuring Local Preference 


with Route-Maps 
_——— eS ce a GAMER ee | 


router (config) # 


route-map name permit sequence 
match condition 
set local-preference value 


* Changes BGP local preference only for routes 
matched by the route-map entry. 


router (config-router) # 


neighbor address route-map name in | out 


¢ Applies route-map to incoming updates from 
specified neighbor or outgoing updates to specified 
neighbor. 

* Per-neighbor local preference is configured by using 
a route-map with no match condition. 
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To have more control over setting local preference, you may be forced to use a route-map. A 
route-map can have more sequenced statements, each with a different set local-preference 
command and a different match condition. If there is no match command, the route-map 
statement will apply local preference to all routes. The route-map can then be applied to BGP 
route updates in either the incoming or outgoing direction. 


Note Applying a route-map to outgoing updates on external sessions will have no effect on local 
preference in the neighboring AS. 


When routers use a route-map to set local preference, the route-map is typically applied to 
incoming BGP routes that are advertised by an EBGP neighbor. The local router uses the local 
preference attribute in BGP route selection. In addition, the router also propagates the attribute 
to all IBGP sessions in the local AS. Normally, no modifications of local preference are made 
on IBGP sessions. This restriction ensures that all routers in the local AS will use the same 
local preference value and make the same decision in the route selection process. 


Note If a network is not matched in any of the route-map statements, the network will be filtered. 
To permit unmatched networks without setting the local preference attribute, you should add 
another route-map statement without match or set commands to the end of the route-map. 
This statement should simply permit the remaining networks. 
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Example 


Configuring Local Preference 
with Route-Maps (Cont.) 


router bgp 2 
neighbor 1.2 
neighbor 1.2 
neighbor 3.4 
neighbor 3.4 
! 


remote-as 462 
route-map L2M in 
remote-as 387 
route-map L64 in 


route-map L2M permit 10 
set local-preference 2000 
! 


route-map L64 in permit 10 
set local-preference 64 


Desired traffic flow 


Default traffic flow 
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In this example, both routers in AS 213 have two external sessions. Using the bgp default 
local-preference command is no longer possible because the second fastest link is on another 
router. 


The configuration here sets local preference according to the bandwidth of the link. A similar 
configuration exists on the bottom router. If the primary (2-Mbps) link fails, the paths that are 
learned through the bottom router in AS 213 (routes with a local preference of 512) will be 
used. 
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Monitoring Local Preference 


This topic lists the Cisco IOS commands that are necessary to monitor BGP local preference. 


Monitoring Local Preference 


° Nondefault local preference is displayed in 
show ip bgp printout. 


* Local preference is displayed in show ip bgp 
prefix printout. 


¢ Local preference is displayed in BGP update 
debugging (only for inbound updates, starting 
with Cisco IOS version 12.0). 


Although local preference is not a mandatory attribute, it is applied to every route. When you 
are using the show ip bgp command, a locally applied default value is not shown. All other 
values are displayed. You should use the command show ip bgp prefix to also display the 
locally applied value. 


The output that is displayed from show and debug commands will vary depending on the Cisco 
IOS version. Newer versions typically display more information. In Cisco IOS version 12.0 and 
in later versions, enabling debugging of incoming routing updates will also display the local 
preference attribute. 
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Example 


Monitoring Local Preference (eont) 


router bgp 213 

no synchronization 

bgp default local-preference 60 
network 10.0.0.0 

neighbor 1.0.0.1 remote-as 213 
neighbor 1.2.0.2 remote-as 462 
neighbor 1.3.0.3 remote-as 387 
neighbor 1.3.0.3 route-map LocPref in 
! 

Route-map LocPref 

set local-preference 90 
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The network that is displayed in the figure was used to collect output from the show and debug 
commands in the next few examples. Every physical connection also includes a BGP session. 
All monitoring and troubleshooting commands were used on router RTR-A. 


RTR-A has one internal and two external neighbors. RTR-B is setting local preference 100 to 
all updates, and RTR-A is setting a default local preference (value 60) for all external updates 
except for those coming from router RTR-D, where a route-map is used to set a local 
preference of 90. The following pages show the output of show and debug commands on 
router RTR-A. 
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Monitoring Local Preference (Cont.) 


Nondefault local preference is displayed in 
show ip bgp printout. 


RTR-A# show ip bgp 

BGP table version is 5, local router ID is 10.1.1.1 

Status codes: s suppressed, d damped, h history, * valid, > best, i - internal 
Origin codes: i - IGP, e - EGP, ? - incomplete 


Network Next Hop Metric LocPrf Weight Path 
*> 10.0.0.0 32768 i 
*>111.0.0.0 i 
* 12.0.0.0 
* 

*>i 
# TA. 026.0 
> 


*>i 


462 i 
387 462 i 
462 i 
462 387 i 
387 i 
462 387 i 


eooo00o00°o 


LocPref coming 
with internal route 


LocPref set with a route map 
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The output in the figure here contains routes with three different local preference values: 


= Network 10.0.0.0/8 originates locally on RTR-A, and the applied default local preference 
60 is not displayed. 


m The second path for network 12.0.0.0/8 was received from RTR-D and received a local 
preference value of 90 by the route-map. 


= All routes that are received from router RTR-B are marked as internal and have a local 
preference value of 100 set on RTR-B. 


Note The output of the show ip bgp command will not display the local preference value if the 
value is the same as the bgp default local-preference value in the local router. In the 
example, RTR-B uses its default local preference value (100). When these routes are 
propagated to RTR-A, RTR-A displays the local preference value of 100 because it is 
different from the default local preference value that is configured on RTR-A. 
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Monitoring Local Preference (Cont.) 


All values for local preference are displayed in the show 
ip bgp prefix printout. 


Default local 
preference is displayed 


RTR-A# show ip bgp 12.0.0.0 
BGP routing table entry for 12.0.0.0/8, version 4 
Paths: (3 available, best #3) 
462 
1.2.0.2 from 1.2.0.2 (12.1.2.3) 
Origin IGP, metric 0, localpref 60, valid, external, ref 2 
387 462 
1.3.0.3 from 1.3.0.3 (14.1.2.3) 
Origin IGP, localpref 90, valid, external, ref 2 
462 
1.1.0.4 (metric 41024000) from 1.0.0.1 (11.0.0.1) 
Origin IGP, metric 0, localpref 100, valid, internal, best, ref 2 
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Use the show ip bgp prefix command to see more detailed information about a specific 
network, including the locally applied default local preference. 


In this example, there are three different paths to reach the same network: 


m The first path is external and was received from router RTR-C. The new default local 
preference value 60 was applied to the update. 


m The second path is external and is received from router RTR-D. The route-map was used to 
set a local preference of 90. 


m= The third path is internal and was received from RTR-B. The update already contained a 
local preference attribute with a value of 100. 


Router RTR-A chose the last path as best because it has the highest local preference. 
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Monitoring Local Preference (Cont.) 


Local preference received in a BGP update is 
displayed in debugging outputs in Cisco IOS 
version 12.0 and later. 


Received local 
preference is displayed 


RTR-A# debug ip bgp 1.0.0.1 updates 12 
BGP updates debugging is on for access list 12 for neighbor 1.0.0.1 


RTR-A# clear ip bgp 1.0.0.1 
03:48:17: BGP: 1.0.0.1 NEXT HOP part 1 net 12.0.0.0/8, next 1.3.0.3 
03:48:17: BGP: 1.0.0.1 send UPDATE 12.0.0.0/8, next 1.3.0.3, metric 0, 
path 387 462 
03:48:17: BGP: 1.0.0.1 rcv UPDATE w/ attr: nexthop 1.1.0.4, origin i, 
localpref 100, metric 0, path 462 
: BGP: 1.0.0.1 rcv UPDATE about 12.0.0.0/8 
: BGP: 1.0.0.1 send UPDATE 12.0.0.0/8 -- unreachable 
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This figure shows the debugging output of incoming BGP updates. Because a router propagates 
the local preference attribute to other routers in the same AS only, local preference will be 
associated with routes sent from internal neighbors. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
isc CO 


Local preference is similar to the weight attribute in that 
you can use both to influence BGP path selection, but it 
differs from the BGP weight attribute in that weight is local 
to a specific router on which it is configured. 


You can use local preference to ensure AS-wide route 
selection policy because it can be seen on neighboring 


routers without the need to reset it. 


You should avoid mixing weight and local preference 
because weight has priority when you are selecting the 
best path. 


Local preference can be configured using either the bgp 
default local-preference preference command or with route- 
map statements. 


You can display local preference with the show ip bgp or 
show ip bgp prefix commands. The former displays only 
nondefault local preference settings. 


References 


For additional information, refer to these resources: 


m= For information on BGP local preference, refer to “Border Gateway Protocol” at the 
following URL: http://www.cisco.com/univercd/cc/td/doc/cisintwk/ito_doc/bgp.htm 


m= For further information on BGP local preference, refer to “Using the Border Gateway 
Protocol for Interdomain Routing” at the following URL: 
http://www.cisco.com/warp/public/459/14. html 


Next Steps 


For the associated lab exercise, refer to the following section of the course Lab Guide: 


m Lab Exercise 4-2: Setting BGP Local Preference 
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Using AS-Path Prepending 


Overview 


In networks where connections to multiple providers are required, it is easy to set and control 
administrative policy for routes leaving an AS under the same administrative control. A 
problem arises when administrative policies mandate a specific return path be used for traffic 
returning to the AS. In this case, administrative policy is difficult to control, because it requires 
service provider administrators to configure their routers to meet the customer administrative 
policy. One BGP mechanism that can potentially resolve the administrative policy issue is AS- 
path prepending. AS-path prepending potentially allows the customer to influence the route 
selection of its service providers. 


This lesson introduces AS-path prepending by describing the problem that AS-path prepending 
solves. Also included in this lesson are the Cisco IOS commands that are required to properly 
configure and monitor AS-path configurations. In addition, the lesson discusses special filtering 
requirements for upstream service providers that are connected to customers that wish to 
influence route selection using AS-path prepending. 


Relevance 


When connections to multiple providers are required, it is important that BGP select the 
optimum route for traffic to use. The optimum, or best, route may not be what the network 
designer intended based on design criteria, administrative policies, or corporate mandate. 
Fortunately, BGP provides many tools for administrators to influence route selection of both 
incoming and outgoing paths. One of these tools is AS-path prepending. 
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Objectives 


Upon completing this lesson, you will be able to influence route selection by using AS-path 
prepending. This includes being able to meet these objectives: 


m™ Describe the need to influence BGP return path selection in a service provider environment 


m™ Describe the function of AS-path prepending and how you can use it to facilitate proper 
return path selection 


m Identify design considerations when you are implementing AS-path prepending to 
influence return path selection 


m Identify the Cisco IOS commands that are required to configure AS-path prepending in a 
multihomed network 


m™ Identify the Cisco IOS commands that are required to monitor the operation of AS-path 
prepending 

m™ Describe the concerns with using AS-path filters when neighboring autonomous systems 
require AS-path prepending 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m™ Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
anil NNNNN(Cisco‘com lm 


° Overview 

* Return Path Selection in a Multihomed AS 

¢ AS-Path Prepending 

* AS-Path Prepending Design Considerations 


¢ Configuring AS-Path Prepending 


* Monitoring AS-Path Prepending 


* AS-Path Filtering Concerns with AS-Path 
Prepending 


* Summary 
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Return Path Selection in a Multihomed AS 


This topic describes the need to influence BGP return path selection in a service provider 
environment. 


Return Path Selection ina 
Multihomed AS 


Desired traffic flow 


¢ Requirement: The return traffic to the customer must arrive 
over the highest-speed access link. 
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It is fairly easy for an AS to select the appropriate path for outgoing traffic. It is much more 
complicated to influence other autonomous systems to select the appropriate path for traffic that 
is returning to a specific AS. 


To configure the preferred path only for outgoing traffic and not for incoming (return) traffic is 
likely to result in asymmetrical traffic flow as well as suboptimal performance of the return 
traffic. In the figure, outgoing traffic is directed to the high-speed line (2 Mbps) as a result of 
configuring local preference or weight. However, the return traffic from AS 387 would take the 
default path over the low-speed line (64 kbps). The low-speed line would be a limiting factor in 
the overall performance that the network could achieve. 


In this example, AS 213 requests AS 387 to send packets toward network 10.0.0.0/8 via AS 
462. The reason for this request is to improve network performance and minimize delay 
(assuming, of course, that the connectivity between AS 387 and AS 462 is better than the direct 
64-kbps link between AS 387 and AS 213). 


Copyright © 2004, Cisco Systems, Inc. Route Selection Using Attributes 4-43 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Default Return Path 


Desired traffic flow 
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¢ Result: The return traffic flows over the path with the shortest 
AS-path length. 
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If no BGP path selection tools are configured on the route to influence the traffic flow, AS 387 
will use the shortest AS path. This action will result in unwanted behavior because the return 
traffic to AS 213 will be sent over the low-speed WAN link. 


AS 213 announces network 10.0.0.0/8 over EBGP sessions to both AS 462 and AS 387. When 

AS 213 sends EBGP updates, it changes the AS-path attribute according to BGP specifications. 
Both AS 462 and AS 387 receive a BGP update for network 10.0.0.0/8 with the AS path set to 

213. 


Because AS 462 selects the route for network 10.0.0.0/8 that it received from AS 213 as its best 
route, AS 462 will use that route and forward it on to AS 387. According to BGP 
specifications, AS 462 also changes the AS-path attribute. AS 387 receives the route to network 
10.0.0.0/8 from AS 462 with an AS path set to 462 213. 


AS 387 has now received two alternative routes to network 10.0.0.0/8 (the direct route from AS 
213 and the route through AS 462). Because nothing is configured in AS 387 to influence the 
flow of traffic, the router will use the BGP route selection rule of shortest AS path to select the 
best return path to network 10.0.0.0/8. 
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Proper Return Path Selection 


Desired traffic flow 


Default traffic flow 


Q: How do you select the proper return path from AS 387? 
A: Use local preference in AS 387 

Q: Will the administrator of AS 387 configure it? 

A: Unlikely 


2004 Cisco Systems, Inc. All rights reserved 


Remember that the incoming traffic flow (from the perspective of AS 213) will be a result of 
the route selection for outgoing traffic in AS 387. The traffic that is going out from AS 387 will 
end up as incoming traffic in AS 213. 


If AS 387 configures some changes that cause the route selection process for outgoing traffic to 
prefer to reach network 10.0.0.0/8 via AS 462, it would result in behavior matching the desired 
administrative policy for AS 213, which specifies that incoming traffic to the AS should be 
received over the high-speed link. 


One way to accomplish the desired administrative policy in AS 213 is to configure the router in 
AS 387, which is receiving EBGP updates directly from AS 213, to assign a local preference 
value less than the default value (100) to all routes that are received from AS 213. The router in 
AS 387 is also configured specifically not to set local preference on EBGP routes that are 
received from AS 462. This configuration results in assignment of the default value of 100 to 
all routes received from AS 462. When the route selection process in AS 387 selects the best 
route to reach network 10.0.0.0/8, the difference in local preference values causes AS 387 
routers to select the path via AS 462 as the best. 


However, all the configuration work to complete this process must be performed in AS 387. 
The network administrators of AS 387 would be required to modify the router configurations in 
AS 387 to satisfy the administrative policy requirements of AS 213. All changes must be 
documented and maintained according to the rules and procedures that have been adopted by 
AS 387. 


If AS 387 is a major ISP, it is most likely that the network administrators are too busy doing 
other things than to tailor router configurations that are based on the demand of a single leaf 
(nontransit) AS that lacks bandwidth on a redundant connection. 
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BGP Route Selection Rules 
ree EE | | 


BGP route selection uses the following criteria: 
° Prefer largest weight 

Prefer largest local preference 

Prefer routes that the router originated 

Prefer shorter AS paths 

Other route selection rules 


Manipulating the outgoing AS-path length could 
result in proper return path selection. 
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Recall that BGP route selection uses the following criteria: 


1. Prefer largest weight 

2. Prefer largest local preference 

3. Prefer routes that the router originated 
4. Prefer shorter AS paths 


5. Then prefer all other route selection criteria 


It is unlikely that the operator of an AS can request changes in router configurations in another 
AS. This situation makes it virtually impossible to influence another AS to select the desired 
path based on the weight and local preference attributes, because both options would require 
configuration changes in the neighboring AS. 


But if both the weight and the local preference parameters are left to their default settings, they 
will not indicate a difference. This situation causes the route selection process to continue down 
the list of selection criteria. The third criterion for selection will not influence route selection in 
this scenario, because none of the routes originated at the router that is performing the route 
selection. The fourth criterion will apply, however, because the AS paths have different lengths. 


If the AS path is not manually manipulated by some administrative means, the path going over 
the fewest number of autonomous systems is selected by the router regardless of available 
bandwidth. However, if the AS that is attempting to influence the incoming traffic flow is 
sending out EBGP updates with a manipulated AS-path attribute over that undesired path, the 
receiver of this update is less likely to select it as the best because the AS path now appears to 
be longer. 


The benefit of manipulating AS paths to influence the route selection is that the configuration 
that is needed is done in the AS that is requesting a desired return path. 
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AS-Path Prepending 


This topic describes the function of AS-path prepending and how you can use it to facilitate 
proper return path selection. 


AS-Path Prepending 


Manual manipulation of AS-path length is 
called AS-path prepending. 


AS path should be extended with multiple 
copies of the AS number of the sender. 
AS-path prepending is used to: 

¢ Ensure proper return path selection 


¢ Distribute the return traffic load for multihomed 
customers 
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You can manipulate AS paths by prepending AS numbers to already existing AS paths. 
Normally, you perform AS-path prepending on outgoing EBGP updates over the nondesired 
return path. Because the AS paths sent out over the nondesired link become longer than the AS 
path sent out over the preferred path, the nondesired link is now less likely to be used as the 
return path. 


The length of the AS path is extended because additional copies of the AS number of the sender 
are prepended to (added to the beginning of) the AS-path attribute. To avoid clashes with BGP 
loop prevention mechanisms, no other AS number, except that of the sending AS, should be 
prepended to the AS-path attribute. 


If another AS number is prepended in the AS path, the routers in the AS that has been 
prepended will reject the update because of BGP loop prevention mechanisms. 


You can configure prepending on a router for all routing updates that you send to a neighbor or 
only on a subset of them. 
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Example 


4-48 


AS-Path Prepending (Cont.) 


Resulting traffic flow 


aS 
Network=10.0.0.0/8 
AS-path=213 


8/0°0°0'0L=140MJON 


Network=10.0.0.0/8 
AS-path=213 213 213 
= ee 


64 kbps 


€bz z9v=ujed-sy 


AS path is extended with the AS number of the sender 


The path with the shortest AS-path length is selected |-; 


¢ Result: The return traffic flows over the desired return path. 


In this example, administrative policy in AS 213 prefers that the low-speed link be used for 
backup purposes only. As long as the high-speed link between AS 213 and AS 462 is available, 
all traffic should flow toward AS 213 using the high-speed link. 


To accomplish this goal, you can configure the router in AS 213 that sends EBGP updates to 
AS 387 by prepending the AS path with two copies of the AS number 213. AS 387 receives 
two alternative routes to reach network 10.0.0.0/8: the update that it has received directly from 
AS 213 (that has a manipulated AS path with a length of three) and the update that it has 
received via AS 462 (that was not manually manipulated and therefore contains an AS-path 
length of two). 


When AS 387 starts the route selection process to determine which route to use to reach 
network 10.0.0.0/8, it checks the AS-path length after the weight and local preference 
parameters. In this case, neither weight nor local preference has been configured, so the length 
of the AS path will be the deciding factor in the route selection process. Consequently, AS 387 
prefers the shortest AS path and thus forwards packets toward network 10.0.0.0/8 via AS 462. 
The desired administrative policy has been met, and AS 213 will receive incoming traffic over 
the high-speed link. 


If the forwarding path from AS 387 via AS 462 to AS 213 and network 10.0.0.0/8 is later 
broken, the BGP update to reach network 10.0.0.0/8 is revoked. In case of such a network 
failure, AS 387 will have only one remaining path to reach network 10.0.0.0/8. The route 
selection process now has only one choice, the route directly to AS 213 over the low-speed 
WAN link. The low-speed link will therefore serve as backup to the high-speed WAN link. 
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AS-Path Prepending (Cont.) 


The update is rejected 
due to loop prevention 


* Prepend the AS path with the AS number of the sender, not the 
AS number of the receiver. 
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When you are manually manipulating AS paths, the only valid AS number that you can 
prepend is the AS number of the sender. Prepending any other AS number will cause problems. 


In the example, AS 213 is prepending AS number 387. The egress router performs AS-path 
prepending when the route is on its way to be transmitted to AS 387. After the manual 
manipulation is made, BGP automatically changes the AS path according to the BGP 
specifications. The local AS number should always be added first when updates are sent over 
an EBGP session. Therefore, when AS 387 receives the BGP update, the AS path contains the 
value 213 387. The AS number 387 was set there by the manual manipulation, and the AS 
number 213 was prepended automatically by BGP because the update was sent over an EBGP 
session. 


When the edge router in AS 387 receives the BGP update, it checks the AS path to verify that 
the BGP updates were not propagated accidentally by a routing loop. Because the edge router 
finds its own AS number in the AS path, it assumes that the BGP update has already been in 
AS 387. According to the BGP specification, the update will be silently ignored. 


Now assume that AS 213 had, for the manual manipulation, used yet a different AS number, 
not its own and not AS number 387. Would AS 387 now have accepted the update? The answer 
is yes. However, in this scenario, a problem would have appeared at a later stage when the 
route finally reached the actual AS belonging to the manually prepended AS number. This AS 
would have rejected the route because it would have found its own AS number somewhere in 
the AS path. 
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AS-Path Prepending Design Considerations 


This topic identifies design considerations when you are implementing AS-path prepending to 
influence return path selection. 


AS-Path Prepending 
Design Considerations 


¢ There is no exact mechanism to calculate the required 
prepended AS-path length. 


° If a primary/backup scenario is desired: 


— Use a long prepended AS path over the backup link to ensure that 
the primary AS path will always be shorter. 


— Along backup AS path consumes memory on every Internet router. 


— Experiment with various AS-path lengths until the backup link 
is idle. 


— Add a few more AS numbers for additional security (unexpected 
changes in the Internet). 


¢ If traffic load distribution is desired: 


— Start with a short prepended AS path, monitor link use, and extend 
the prepended path length as needed. 


— Continuously monitor the link use and change the prepended 
AS-path length if required. 
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How many copies of the AS number of the sender should you prepend to the AS path? The 
answer depends on the goals of the administrative policy. In the general case, it is not easy to 
determine the exact number of required AS numbers to prepend. The sending AS does not 
know what alternative paths are available to other autonomous systems. 


The following are two typical cases where you can use AS-path prepending for return path 
selection. 


= Establishing a primary/backup link: As an announced backup (prepended) route 
propagates through the Internet, all the routers along the way that receive the route need to 
store it together with its AS-path attribute. If this information is long, it will consume extra 
memory in these routers. However, because routers forward only routes that are selected as 
“best,” an AS that receives multiple alternatives to a destination will select the route with 
the shortest AS path and forward only that route. 


In the case where both the primary and the secondary link are up, the neighboring AS will 
receive two routes to the same destination that differ only in the AS-path length. The route 
with the shorter AS path will be subsequently advertised through the Internet. 


In the case where the primary link fails, the route with the longer AS path is the only 
remaining route. As a result, the primary route is withdrawn, and the prepended route is 
advertised through the Internet. In this case, extra memory will be consumed in each 
Internet router because of the storage of the prepended (longer) AS path. 


The longer the AS path that is announced to the EBGP neighbor on the other side of the 
backup link, the less likely it is that incoming traffic will be received from that neighbor. 
The network administrator can make a clever guess about how many copies of the AS 
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number to prepend. After the prepending is implemented, the network administrator has to 
examine the result. If the expected result is not achieved, the configuration can be changed 
and a few more copies of the AS number can be prepended. 


After AS-path prepending has successfully generated the desired results, the network 
administrator may take a step of precaution by prepending a few more copies of the AS 
number to the AS path. This action protects the customer from packets being routed over 
the backup link at a possible later stage when the topology between remote autonomous 
systems has unexpectedly changed, yielding a longer AS path to reach the primary link. 


= Distributing the load of return traffic: In a multihomed scenario, there is no way to 
exactly predetermine the volume of traffic that will be received over a particular link. The 
traffic load on different links will change depending on where the senders are located 
(which autonomous systems they belong to). The network topology and the way that 
different remote autonomous systems are interconnected may also change with time, 
changing the load distribution. Only constant monitoring and fine-tuning will ensure that 
the desired results are achieved. 


In a first attempt at load distribution, the network administrator can configure a router that 
is connected to an overused link to prepend only a few extra copies of the local AS number. 
After the network has been given time to converge, the network administrator must check 
the change in load distribution. Monitoring of the load must be done for a period long 
enough to be statistically significant (several days or more). If enough volume of traffic has 
not moved from the overused link to the underused link, the administrator must prepend 
more copies of the local AS number, and the process of resending local routes and 
monitoring the results starts all over again. 
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Configuring AS-Path Prepending 


This topic identifies the Cisco IOS commands that are required to configure AS-path 
prepending in a multihomed network. 


Configuring AS-Path rrepend’ ng 


router (config) # 


route-map name permit sequence 
match condition 
set as-path prepend as-number [ as-number ... ] 


* Prepends the specified AS number sequence to the 
routes matched by the route-map entry 


¢ AS numbers are prepended to the AS path from the 
BGP table; the AS number of the sender is always 
prepended to the end result 


router (config-router) # 


neighbor address route-map name out 


* Applies the route-map to outgoing updates sent to 
the specified BGP neighbor 
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You can configure manual manipulation of the AS-path attribute (prepending) using a route- 
map with the set as-path prepend command. The route-map is used to prepend the specified 
AS numbers to outgoing EBGP route updates that are matched with the match condition, as 
specified in the route-map. AS-path prepending is completed first, and then the route is subject 
to the normal AS-path modification procedures when it is sent over an EBGP session. 


You can also use the route-map to select only a subset of routes that should have their AS path 
manually manipulated. Use the set as-path prepend command with the appropriate route-map 
permit statement. 


Note Changing an outgoing route-map affects only the BGP updates that are sent after the 
change. In order to propagate the new and longer AS path with all announced routes, the 
routes must all be resent by the router. To do this, use the privileged EXEC command clear 
ip bgp with the soft out qualifier. 
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set as-path 
To modify an AS path for BGP routes, use the set as-path route-map configuration command. 


m™ set as-path {tag | prepend as-path-string} 

To not modify the AS path, use the no form of this command. 
™ no set as-path {tag | prepend as-path-string} 

Syntax Description 


Parameter Description 


tag Converts the tag of a route into an AS path. Applies only when 
redistributing routes into BGP. 


prepend as-path-string Appends the string that follows the keyword prepend to the AS 
path of the route that is matched by the route-map. Applies to 
inbound and outbound BGP route-maps. 
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Example 


Configuring AS-Path Frepending (Cont.) 


route-map prepend permit 10 
set as-path prepend 213 213 213 213 213 
! 


router bgp 213 


neighbor 1.0.0.2 remote-as 387 
neighbor 1.0.0.2 route-map prepend out 
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In this example, the lower router in AS 213 is configured to prepend its own AS number five 
times for all updates that are sent to the EBGP neighbor 1.0.0.2 in AS 387. This configuration 
will result in AS 387 receiving a route to network 10.0.0.0/8 with an AS path containing the AS 
number 213 six times (213 213 213 213 213 213). In accordance with BGP specifications, 
Cisco IOS software automatically adds the sixth copy of the AS number as the route leaves AS 
213. 


The configuration of the AS 213 router is completed in two steps: 


Step 1 First, a route-map named “prepend” is created. The route-map selects all BGP routes 
and prepends five copies of 213 to the existing AS-path attribute that is already 
attached to each route. The lack of match conditions in the route-map indicates that 
all routes are matched. 


Step 2 The route-map is applied to all outgoing updates to the EBGP neighbor 1.0.0.2. 
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Monitoring AS-Path Prepending 


This topic identifies the Cisco IOS commands that are required to monitor the operation of AS- 
path prepending. 


Monitoring AS-Path erepenalng 


AS-path prepending cannot be monitored or 
debugged on the sending router. 


* debug ip bgp updates displays the BGP entry prior 
to route-map processing. 


* show route-map does not display how many routes 
have matched a route-map entry. 


Results of AS-path prepending can be 
observed on the receiving router. 
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When you are monitoring AS-path prepending, the router doing the prepending is not the 
proper point to observe the results of the AS-path prepend operation. For instance, output from 
the debug ip bgp updates command does not display the prepended paths, because the route- 
map doing the prepending is applied afterward. 


The show route-map command displays the configuration details of a route-map. The 
matching criteria and AS-path manipulation are displayed as output of the command. However, 
there is no indication of how many routes have been matched by a route-map statement and 
thus had their AS paths manipulated. 


A better place for observing AS-path prepending is on the router receiving the BGP update that 
contains the prepended AS path. At that point, you can use the pattern of AS number sequences 
in the received AS-path attribute of received routes to find the routes that have a prepended AS 
path. 
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Monitoring AS-Path Prepending (Cont) 


router> 


show ip bgp regexp regular-expression 


* Displays all BGP routes with AS paths matching a 
regular expression 


AS387# show ip bgp regexp *213 213_ 

BGP table version is 2, local router ID is 1.0.0.2 

Status codes: s suppressed, d damped, h history, * valid, > best, 
i - internal 

Origin codes: i - IGP, e - EGP, ? - incomplete 


Network Next Hop Metric LocPrf Weight Path 
*> 10.0.0.0 1.0.0.1 e) O P2tSe2iseeas) 1 


002G_233 
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In the figure, the show ip bgp regexp command is used to find all the routes in the BGP table 
of the receiving router in AS 387 that are directly received from AS 213 and have at least one 
extra copy of AS number 213 in their AS path. Network 10.0.0.0/8 is displayed as the only 
route meeting this selection criterion. The AS path has been prepended with two extra copies of 
AS 213. The egress router in AS 213 automatically added the third copy of AS 213 because the 
route was sent across an EBGP session. 
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AS-Path Filtering Concerns with AS-Path 
Prepending 


This topic describes the concerns of using AS-path filters when neighboring autonomous 
systems require AS-path prepending. 


AS-Path Filtering Concerns—AS-Path 
Prepending 


AS 213 
10.0.0.0/8 


ip as-path access-list 10 permit *[0-9]+$ 
! 


router bgp 387 
neighbor 1.0.0.1 remote-as 213 
neighbor 1.0.0.1 filter-list 10 in 


* Service providers usually use AS-path filters to control 
incoming BGP updates from their customers. 
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Service providers normally expect their customers to send routes that originate only in the AS 
of the customer. However, because customers might not do so, proactive thinking and care for 
the rest of the Internet cause the service provider to implement AS-path filters on incoming 
updates that are received from their customers. 


The network administrator of the service provider in the figure could configure individual 
filters for each neighbor. However, a single AS-path access-list permitting only AS paths with a 
length of exactly one AS number would be a better solution because the service provider can 
uniformly apply it to all incoming routes from all customers (possibly using a peer group). 


In the figure, the service provider (AS 387) has configured a filter-list, which allows only AS 
paths that have a length of one AS number. When the customer changes its router configuration 
and starts to announce network 10.0.0.0/8 with a prepended AS path, the filter-list for incoming 
routes to AS 387 in the service provider router will filter those routes out. This filtering results 
in a situation where the network 10.0.0.0/8 is not reachable over the link between AS 213 and 
AS 387. Therefore, the backup function is not available. 


Network 10.0.0.0/8 is, however, still reachable via the path going through AS 462. This 
situation means that AS 387 can send packets to network 10.0.0.0/8 but not over the direct link 
to AS 213. This failure may be hard to detect because, during normal conditions, all 
autonomous systems in the figure can exchange traffic. 
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After AS 387 loses the route to network 10.0.0.0/8 via AS 462, possibly because the primary 
link between AS 213 and AS 462 is gone, the problem will be obvious. AS 387 can now no 
longer reach network 10.0.0.0/8 at all, although the physical link between AS 213 and AS 387 
is available. 


AS-Path Filtering Concerns—AS-Path 
Prepending (Cont.) 


° The incoming AS-path filters of the service 
provider need to be modified to support AS-path 
prepending. 


* To support AS-path prepending, service providers 
should implement regular expression variables to 
create a uniform AS-path filter for all customers. 


—Example: “([0-9]+)(_\1)*$ 
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Because the AS of the service provider will receive customer routes with prepended AS-paths 
that have a length greater than one AS number, the provider must modify its incoming filters. 


The service provider needs to create a new inbound regular expression filter, using regular 
expression variables and parentheses for recall. 


What is needed is a filter that will allow any AS path containing one or multiple copies of the 
same AS number. An example of such a filter is as follows: 


m ‘((0-9]+)(\1)*$ 


This filter matches any AS path beginning with any AS number and continues with none or 
multiple repetitions of that same AS number (the variable “\1” repeats the value in the 
brackets). The regular expression would therefore match AS paths 99 99 99, 2 2 2, or 100, but 
it would not match AS path 100 99. 


4-58 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


AS-Path Filtering Concerns—AS-Path 
Prepending (Cont.) 


Network=10.0.0.0/8 
AS-path=213 213 


ip as-path access-list 10 permit *213 (_213) *$ 
! 


router bgp 387 
neighbor 1.0.0.1 remote-as 213 
neighbor 1.0.0.1 filter-list 10 in 


In the figure, the service provider (AS 387) has configured an individual filter for all routes that 
are received directly from AS 213. The AS path is required to start with 213. Then multiple 
copies of 213 may follow it. The asterisk allows for zero occurrences, permitting the AS path 
with a single copy of 213 as well. 


If the same service provider router has more customers that are attached to it, they will all 
require an individual filter-list because the AS number of the customer is explicitly indicated in 
the regular expression. 


An alternative would be to implement the AS-path filter by using regular expression variables. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 


¢ If the preferred path for incoming (return) traffic is not 
configured, the likely result is an asymmetrical traffic 
flow as well as suboptimal performance of the return 
traffic. 


* AS-path prepending is performed on outgoing EBGP 
updates over the nondesired return path or the path 
where the traffic load should be reduced. 


* You should use a long prepended AS path over the 
backup link to ensure that the primary AS path will 
always be shorter. However, care should be taken 
because a long backup AS path consumes memory. 


¢ Manual manipulation of the AS-path attribute 
(prepending) is configured using a route-map with the 
set as-path prepend command. 


Summary (Cont.) 


¢ Monitoring AS-path prepending is best 
accomplished on the router that is receiving the 
prepended routes because the prepended path will 
not be visible on the prepending router. 


¢ You can use the show ip bgp regexp command to 
find all the routes on the receiving router with 
prepended AS paths. 


* Service providers with customers that use AS-path 
prepending must create new AS-path filters using 
specific AS-path entries or with regular expression 
variables to accommodate AS-path lengths greater 
than one AS number. 
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References 


For additional information, refer to this resource: 


m= For more information on AS-path prepending, refer to “BGP Case Studies 3” at the 


following URL: 
http://www.cisco.com/en/US/tech/tk365/tk80/technologies_tech_note09186a00800c95bb.s 
html 
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Understanding the BGP 
Multi-Exit Discriminator 


Overview 


This lesson discusses how to influence BGP route selection by setting the BGP MED attribute 
of outgoing BGP routes. The MED attribute is a hint to external neighbors about the preferred 
path into an AS when multiple entry points exist. Two methods that are used to set the MED 
attribute are discussed in this lesson: the default MED and route-maps. In addition to basic 
MED attribute configuration, advanced commands to manipulate MED properties are 
discussed. This lesson also explains how to monitor and troubleshoot the BGP table to verify 
correct MED configuration and to properly influence path selection. 


Relevance 


When connections to multiple providers are required, it is important that BGP select the 
optimum route for traffic to use. It is equally important that the return path that is selected be 
the optimum return path into the AS. The optimum, or best, route may not be what the network 
designer intended based on design criteria, administrative policies, or corporate mandate. 
Fortunately, BGP provides a tool for administrators to influence route selection, the MED 
attribute. 
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Objectives 


Upon completing this lesson, you will be able to influence route selection by using the MED 
attribute. This includes being able to meet these objectives: 


m™ Describe how the MED can be used to facilitate proper return path selection 
m Describe MED propagation inside and between autonomous systems 


m Identify the Cisco IOS command that is required to configure the default BGP MED ona 
router 


m Identify the Cisco IOS commands that are required to configure the BGP MED using route- 
maps 


m Identify the Cisco IOS commands that are required to configure advanced MED properties 
m Identify the Cisco IOS commands that are required to monitor the BGP MED 
m™ Identify the Cisco IOS commands that are required to troubleshoot the BGP MED 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m™ Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
_ OO ee (Cisco.com 


° Overview 

° Selecting the Proper Return Path 

* MED Propagation in a BGP Network 
° Changing the Default MED 

° Changing the MED with Route-Maps 


¢ Advanced MED Configuration 
° Monitoring the MED 

¢ Troubleshooting the MED 

° Summary 
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Selecting the Proper Return Path 


This topic describes how you can use the MED attribute to facilitate proper return path 
selection. 


Selecting the Proper Return Path 


Desired traffic flow 


Default traffic flow 


Q: How can you make sure that the return traffic takes the 
right path? 
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When multiple connections between providers are required, BGP attributes such as weight and 
local preference solve only half the problem: how to choose the right path out of the AS. This 
topic focuses on the second, more complex half of the same problem: how to influence 
neighboring autonomous systems to choose the correct return path back into the AS. 
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Multi-Exit Discriminator 
_————————— nm Ciscocoman| 


* You can use the MED to influence path selection in 
neighbor autonomous systems. 


* An AS can specify its preferred entry point using the 
MED in outgoing EBGP updates. 


* The MED is not propagated outside of a receiving AS. 


¢ The default value of the MED attribute is 0. 

¢ The MED is called “metric” in Cisco IOS software. 
¢ The MED is a “weak” metric. 

* A lower MED value means more preferred. 


BGP v3.1—4-4 


You can apply the MED attribute on outgoing updates to a neighboring AS to influence the 
route selection process in that AS. The MED attribute is useful only when there are multiple 
entry points into an AS. 


The MED attribute, which is sent to an external neighbor, will be seen only within that AS. An 
AS that receives a route that contains the MED attribute will not advertise that MED beyond its 
local AS. 


The default value of the MED attribute is 0. In addition, a lower value of MED is more 
preferred. 


The MED attribute is considered a “weak” metric. In contrast with weight and local preference, 
a router will prefer a path with the smallest MED value but only if weight, local preference, AS 
path, and origin code are equal. Using the MED may not yield the expected result if the 
neighboring AS modifies any of the stronger BGP route selection mechanisms. 


Note The term that is used in Cisco IOS software for MED is “metric.” The term “metric” also 
applies to the set command that is used in route-maps as well as all show and debug 
commands. 
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MED Propagation in a BGP Network 


This topic describes how the value of the MED attribute changes inside a BGP AS and between 
different BGP autonomous systems. 


MED Propagation in a BGP Network 


MULTI_EXIT_DISC MULTI_EXIT_DISC 
can be modified removed for routes not 
with a route-map originated in local AS 


P ~~ A 


External External 
or Dect BGP table BGP peer 


Intra-confederation Intra-confederation 
EBGP peer : - EBGP peer 
<= Main routing : 

. table 


Internal & a Internal 
BGP peer BGP peer 


MULTI_EXIT_DISC copied 
from main routing table for 
locally originated networks 


MULTI_EXIT_DISC 
can be modified 
with a route-map 


BGP v3.1—4-5 


The figure shows how the value of the MED attribute is assigned depending upon the routing 
information source. A route-map must be configured on a router to manually assign a value to 
the MED attribute. For those networks that are also present in the BGP table, the router assigns 
a default value from the metric in the routing table and copies it into the MED attribute. The 
MED attribute is automatically removed on external sessions if the attribute did not originate in 


the local AS. 
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Changing the Default MED 


This topic lists the Cisco IOS command that is required to configure changes to the default 
BGP MED on a Cisco IOS router. 


Changing the Default MED 


router (config-router) # 


default-metric number 


° The MED is copied from the IGP cost in the router 
that sources the route (through the network 
command or through route redistribution). 


¢ You can change the MED value for redistributed 
routes with the default-metric command. 


The MED is not a mandatory attribute, and there is no MED attribute that is attached to a route 
by default. The only exception is if the router is originating networks that have an exact match 
in the routing table (through the network command or through redistribution). In that case, the 
router uses the metric in the routing table as the MED attribute value. 


Using the default-metric command in BGP configuration mode will cause all redistributed 
networks to have the specified MED value. 


default-metric (BGP) 


To set the default metric value (MED) for BGP routes, use the default-metric command in 
router configuration mode. 


= default-metric number 


To returm to the default state, use the no form of this command. 


= no default-metric number 


Syntax Description 


Parameter Description 


number Default metric value that is appropriate for the specified routing 
protocol 
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Changing the MED with Route-Maps 


This topic lists the Cisco IOS commands that are required to configure changes to the BGP 
MED attribute with route-map statements. 


Changing the MED with Route-Maps 
Ie ( e 


router (config) # 


route-map name permit sequence 
match condition 
set metric value 


¢ Changes MED for routes matched by the route-map 
entry 


router (config-router) # 


neighbor address route-map name in | out 


¢ Applies a route-map to incoming updates from a 
specified neighbor or to outgoing updates to a 
specified neighbor 


* Per-neighbor MED is configured by using a route-map 
with no match condition 


BGP v3.1—4-7 


You can use a route-map to set the MED on incoming or outgoing updates. Use the set metric 
command within route-map configuration mode to set the MED attribute. 
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Example 


Changing the MED with Route-Maps (Cont.) 


router bgp 213 

neighbor 1.2.3.4 remote-as 462 
neighbor 1.2.3.4 route-map MED out 
! 


route-map MED 
set metric 100 


Desired traffic flow 


Default traffic flow 


router bgp 213 

neighbor 3.4.5.6 remote-as 462 
neighbor 3.4.5.6 route-map MED out 
! 


route-map MED 
set metric 5000 


BGP v3.1—4-8 


The example here shows how to set a per-neighbor MED on an outgoing update. The result of 
this action is that the neighboring AS will prefer the upper link to AS 213. The solution, of 
course, relies on whether the neighboring AS is not changing the weight, local preference, AS- 
path, or origin code attributes in updates that it receives from AS 213. 
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Advanced MED Configuration 


This topic lists the Cisco IOS commands that are required to configure advanced MED features 
on Cisco routers. 


Advanced MED Configuration 
a ed 


router (config-router) # 


bgp always-compare-med 


° By default, the MED is considered only during selection of 
routes from the same autonomous system. 


* With always-compare-med, the MED is also considered for 


routes coming from a different AS. 


router (config-router) # 


bgp bestpath med missing-med-worst 


° If the MED is not attached to a BGP route, it is interpreted 
as value 0, and thus as the best metric. 


¢ With this command, a missing MED is interpreted as 
infinity (worst). 


BGP v3.1—4-9 


Several rules exist on when and how you should use the MED attribute: 


m You should use the MED in the route selection process only if both (all) paths come from 
the same AS. Use the bgp always-compare-med command to force the router to compare 
the MED even if the paths come from different autonomous systems. You need to enable 
this option in the entire AS; otherwise, routing loops can occur. 


™ According to a BGP standard describing MED, you should regard a missing MED attribute 
as an infinite value. Cisco IOS software, on the other hand, regards a missing MED 
attribute as having a value of 0. Use the bgp bestpath med missing-med-worst command 
when combining different vendor equipment. An even better solution is to make sure that 
every update carries a MED attribute. 
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Advanced MED Configuration (Cont.) 
————————————— ee ee / any SK Teen 


router (config-router) # 


bgp bestpath med confed 


° By default, the MED is considered only during selection of 
routes from the same autonomous system, which does 
not include intra-confederation autonomous systems. 


* Use this command to allow routers to compare paths 
learned from confederation peers. 


router (config-router) # 


bgp deterministic-med 


* This command changes the BGP route selection 
procedure to a deterministic but slower one. 


BGP v3.1—4-10 


You must use the command bgp bestpath med confed when you use the MED within a 
confederation to influence the route selection process. A router will compare MED values for 
those routes that originate in the confederation. 


When you enable a deterministic MED comparison, you allow a router to compare MED values 
before it considers BGP route type (external or internal) and Interior Gateway Protocol (IGP) 
metric to the next-hop address. The router will compare MED values immediately after the AS- 
path length. 


Note Cisco recommends enabling the bgp deterministic-med command in all new network 
rollouts. For existing networks, you must deploy the command either on all routers at the 
same time or incrementally, with care to avoid possible IBGP routing loops. 
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Example 


The following example demonstrates how the bgp deterministic-med and bgp always- 
compare-med commands can influence MED-based path selection. Consider the following 
BGP routes for network 172.16.0.0/16 in the order that they are received: 


entry 1: AS(PATH) 65500, med 150, external, rid 192.168.13.1 
entry 2: AS(PATH) 65100, med 200, external, rid 1.1.1.1 


entry 3: AS(PATH) 65500, med 100, internal, rid 192.168.8.4 


Note BGP compares multiple routes to a single destination in pairs, starting with the newest entry 
and moving toward the oldest entry (starting at the top of the list and moving down). For 
example, entry 1 and entry 2 are compared. The better of these two is then compared to 
entry 3, and so on. 


In the case where both commands are disabled, BGP compares entry 1 and entry 2. Entry 2 is 
chosen as the best of these two because it has a lower router-ID. The MED is not checked 
because the paths are from a different neighbor AS. Next, entry 2 is compared to entry 3. BGP 
chooses entry 2 as the best path because it is external. 


In the case where bgp deterministic-med is disabled and bgp always-compare-med has been 
enabled, BGP compares entry 1 to entry 2. These entries are from different autonomous 
systems, but because the bgp always-compare-med command is enabled, the MED is used in 
the comparison. Entry 1 is the better of these two entries because it has a lower MED value. 
Next, BGP compares entry 1 to entry 3. The MED is checked again because the entries are now 
from the same AS. BGP chooses entry 3 as the best path. 


In the case where bgp deterministic-med has been enabled and bgp always-compare-med 
has been disabled, BGP groups routes from the same AS together and compares the best entries 
of each group. The BGP table looks like the following. 


entry 1: AS(PATH) 65100, med 200, external, rid 1.1.1.1 
entry 2: AS(PATH) 65500, med 100, internal, rid 192.168.8.4 
entry 3: AS(PATH) 65500, med 150, external, rid 192.168.13.1 


There is a group for AS 65100 and a group for AS 65500. BGP compares the best entries for 
each group. Entry 1 is the best of its group because it is the only route from AS 100. BGP 
compares entry 1 to the best of group AS 65500, entry 2 (because it has the lowest MED). 
Because the two entries are not from the same neighbor AS, the MED is not considered in the 
comparison. The EBGP route wins over the IBGP route, making entry 1 the best route. 


If bgp always-compare-med were also enabled, BGP would have taken the MED into account 
for the last comparison and have selected entry 2 as the best path. 
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Monitoring the MED 


This topic lists the Cisco IOS commands that are required to monitor the BGP MED attribute 
on a Cisco router. 


Monitoring the MED 
a ee a GENT = =| 


* MED is displayed in show ip bgp [prefix] printout as 
the metric field 


* MED after route-map processing is displayed in 
BGP update debugging 


¢ MED received from a neighbor is displayed in show 
ip bgp neighbor received-routes printouts 


BGP v3.1—4-11 


All BGP-related show and debug commands display the value of the MED attribute. If the 
inbound soft reconfiguration feature is enabled on the router, the original MED attribute that is 
received by the router is also displayed. The following examples demonstrate command output 
for Cisco show ip bgp commands. 
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Example 


Monitoring the MED (Cont.) 


router bgp 213 


no synchronization 


network 10.0.0.0 
neighbor 1.0. 
neighbor 1.2. 
neighbor 1.2. 
neighbor 1.3. 
! 

Route-map SetMED 
set metric 500 


ls 
2 
-2 
-3 


The same network as in the previous lesson on BGP local preference is used in this topic to 
produce the sample output that is shown on the next pages. All commands were executed on 


router RTR-C. 


remote-as 
remote-as 
route-map 
remote-as 


BGP v3.1—4-12 


Some routing updates from router RTR-B are sent to router RTR-C with a MED of 500. Some 
updates from RTR-B to RTR-C have the MED set to 0, and some are without a MED attribute. 


Inbound soft reconfiguration is used on router RTR-C. 
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4-75 


Monitoring the MED (Cont.) 


* MED is displayed in show ip bgp printout. 


RTR-C# show ip bgp 

BGP table version is 4, local router ID is 12.1.2.3 

Status codes: s suppressed, d damped, h history, * valid, > best, i - internal 
Origin codes: i - IGP, e - EGP, ? - incomplete 


Network Metric LocPrf Weight Path 
> 500 213 i 

213 i 

213): 

213 i 


No MED in this external route 


BGP v3.1—4-13 


Both networks that are received from router RTR-B have a MED of 500. Network 10.0.0.0/8, 
which is received from RTR-A, has no MED attribute, while network 11.0.0.0/8 has a MED 


value of 0. 
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Monitoring the MED (Cont.) 


¢ MED values are also displayed in show ip bgp prefix 
printout. 


RTR-C# show ip bgp 10.0.0.0 
BGP routing table entry for 10.0.0.0/8, version 2 
Paths: (2 available, best #2, advertised over EBGP) 
213 
132.0: Lromad. 22.0.0 /CLOn diel) 
Origin IGP, metric 500, localpref 100, valid, external 
213 
1.1.0.1 from 1.1.0.1 (11.0.0.1) 
Origin IGP, localpref 100, valid, external, best 


MED is displayed only for those 
routes that contain MED attribute 


BGP v3.1—4-14 


When looking at detailed information for a specific network, you will see the MED (via show 
ip bgp prefix) only if the attribute exists. 
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Troubleshooting the MED 


This topic lists the Cisco IOS commands that are required to troubleshoot BGP MED 
configurations on a Cisco router. 


Troubleshooting the MED 
a 


* MED sent to a neighbor (after the outgoing route- 
map) is displayed in debugging outputs. 


RTR-B# debug ip bgp upd 10 

BGP updates debugging is on for access list 10 
RTR-B# debug ip bgp event 

BGP events debugging is on 

RTR-B# clear ip bgp 1.2.0.2 soft out 


00:46:04: BGP: start outbound soft reconfiguration for 1.2.0.2 

00:46:04: BGP: 1.2.0.2 computing updates, neighbor version 0, 

table version 5, starting at 0.0.0.0 

00:46:04: BGP: 1.2.0.2 send UPDATE 10.0.0.0/8, next 1.2.0.1, 

metric 500, path 213 

00:46:04: BGP: 1.2.0.2 update run completed, ran for 8ms, neighbor 
version 0, start version 5, throttled to 5, check point net 0.0.0.0 ! 


MED sent to the 
neighbor is displayed 


BGP v3.1—4-15 


In case debugging is necessary to troubleshoot a problem, the MED, among other attributes, is 
displayed. This example shows the MED attribute set with an outgoing route-map. 
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Troubleshooting the MED (Cont.) 


* MED stored in the BGP table (after the incoming 
route-map processing) is displayed in debugging 
outputs. 


RTR-C# debug ip bgp update 10 
BGP updates debugging is on for access list 10 
RTR-C# clear ip bgp 1.2.0.1 


01:03:45: BGP: 1.2.0.1 send UPDATE 10.0.0.0/8, next 1.2.0.2, 
metric 0, path 462 213 

01:03:45: BGP: 1.2.0.1 rcv UPDATE about 10.0.0.0/8, next hop 
1.2.0.1, path 213 metric 500 


0026_069 


MED stored in the BGP 
table is displayed 


BGP v3.1—4-16 


This debugging example shows the MED attribute value after the update has been processed by 
an incoming route-map. 


Troubleshooting the MED (Cont) 


* Original MED received from a neighbor (before the 
incoming route-map processing) is displayed in show 
ip bgp neighbor received. 


RTR-C# show ip bgp neighbors 1.1.0.1 received-routes 

BGP table version is 19, local router ID is 12.1.2.3 

Status codes: s suppressed, d damped, h history, * valid, > best, i - 
internal 

Origin codes: i - IGP, e - EGP, ? - incomplete 


Network Metric LocPrf Weight Path 
* 10.0.0.0 ee eo 0 213 i 
* 11.0.0.0 -1.0. fe) 0 213 i 


Total number of prefixes 2 


MED originally received 
from the neighbor 


To see the original MED, you need to enable soft reconfiguration on the router. The command 
show ip bgp neighbor address received-routes displays the original updates before any filters 
or route-maps have filtered or changed them. 
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Troubleshooting the MED (Cont.) 


* Both original route and modified route are displayed 
with a route-map when inbound soft reconfiguration 
is configured. 


Modified route (MED set to 1000) 
RTR-C# show ip bgp 10.0.0.0 


BGP routing table entry for 10.0.0.0/8, version 17 
Paths: (4 available, best #4, advertised over EBGP) 
213 
1.1.0.1 from 1.1.0.1 (11.0.0.1) 
Origin IGP, metric,1000, localpref 100, valid, external 
213, (received-only) 
1.1.0.1 from 1.1.0.1 (11.0.0.1) 
Origin IGP, localpref,100, valid, external 
387 213 
1.1.0.3 from 1.1.0.3 (14.1.2.3) 
Origin IGP, localpref 100, valid, external 
213 
1.2.0.1 from 1.2.0.1 (10.1.1.1) 
Origin IGP, metric 500, localpref 100, valid, external, best 


0026_071 


Original route (no MED) 


BGP v3.1—4-18 


If soft reconfiguration is enabled, the original updates to the MED attribute are available by 
using the show ip bgp prefix command. The original versions are marked with the received- 
only keyword and follow the version that is in the global BGP table. In the figure, the received 
update had no MED attribute but was later applied a value of 1000 through a route-map. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
el 


¢ In most cases the MED is used to achieve 
symmetrical routing. 


° The MED is a “weak” parameter in the route selection 
process - it is used only if weight, local preference, 
AS path, and origin code are equal. By default, the 
MED is compared only for paths that were received 
from the same autonomous system. 


* The MED is not a mandatory attribute and is normally 
not present in BGP updates. An exception is whena 
router originates a network that has an exact match in 
the routing table — the MED is given a value copied 
from the metric in the routing table. 


* You can use a route-map to set an arbitrary MED 
value to sent or received routes. 


Summary (Cont.) 


¢ You can configure advanced MED parameters to 
modify the default MED behaviors. For example, 
the bgp always-compare-med command forces the 
router to compare the MED even if paths came 
from different autonomous systems. 


° The MED is displayed in show commands as the 
metric field. 


¢ The MED that was stored in the BGP table after 
processing the incoming route-map is displayed in 
the output of the debug ip bgp update command. 
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References 


For additional information, refer to these resources: 


m= For more information on the BGP MED, refer to “Border Gateway Protocol” at the 
following URL: http://www.cisco.com/univercd/cc/td/doc/cisintwk/ito_doc/bgp.htm 


= For more information on BGP communities, refer to “Using the Border Gateway Protocol 
for Interdomain Routing” at the following URL: 
http://www.cisco.com/univercd/cc/td/doc/cisintwk/ics/icsbgp4.htm 


Next Steps 


For the associated lab exercise, refer to the following section of the course Lab Guide: 


m Lab Exercise 4-3: Understanding BGP Multi-Exit Discriminators 
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Addressing BGP Communities 


Overview 


This lesson discusses how to influence BGP route selection by setting the BGP community 
attribute on outgoing BGP routes. The community attribute provides a method to facilitate and 
simplify the control of routing information by grouping destinations into a specific community. 
Routing decisions can then be influenced based on the identity of a group, which simplifies the 
configuration requirements of BGP when you are applying administrative policies. 


In this lesson, BGP communities and their use to facilitate proper return path selection are 
discussed. The configuration details of BGP communities, and the use of community-lists and 
route-maps to influence route selection are also discussed. This lesson concludes by explaining 
how to monitor BGP community attributes. 


Relevance 


The community attribute is a transitive optional BGP attribute, which was designed to group 
destinations and allow the easy application of administrative policies. BGP communities 
provide a mechanism to reduce BGP configuration complexity on a router controlling the 
distribution of routing information. When connections to multiple providers are required, it is 
important that BGP select the optimum route for traffic to use. It is equally important that the 
return path that is selected be the optimum return path into the AS. The optimum, or best, route 
may not be what the network designer intended based on design criteria, administrative 
policies, or corporate mandate. Fortunately, BGP provides tools for administrators to influence 
route selection. The BGP community attribute is one such tool. 
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Objectives 


Upon completing this lesson, you will be able to influence route selection by using the BGP 
community attribute. This includes being able to meet these objectives: 


m Describe the issues of return path selection for multihomed customers 

m™ Describe the basic qualities of BGP communities 

m Describe how you can use BGP communities to facilitate proper return path selection 

m List the steps that are required to successfully deploy communities in a BGP-based network 


m™ Identify the Cisco IOS commands that are required to configure route tagging with BGP 
communities 


m Identify the Cisco IOS command that is required to configure BGP community propagation 


m Identify the Cisco IOS commands that are required to match routes based on attached BGP 
communities using community-lists 


m Identify the Cisco IOS command that is required to match routes based on attached BGP 
communities using route-maps 


m Identify the Cisco IOS commands that are required to monitor BGP communities 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m™ Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
—————————— nan Cisco’con ana 


° Overview 

° Selecting the Proper Return Path 
* BGP Communities Overview 

* Using Communities 

* Configuring BGP Communities 


* Configuring Route Tagging with BGP 
Communities 


° Configuring Community Propagation 
Defining BGP Community-Lists 
Matching BGP Communities with Route-Maps 
Monitoring Communities 
Summary 


ms, Inc. All rights reserved 
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Selecting the Proper Return Path 


This topic describes the issues of return path selection for multihomed customers and why you 
cannot use the BGP attributes of weight, local preference, and MED to solve these issues. 


Selecting the Proper Return Path 


Desired traffic flow 


ee el CL 
64 kbps 


Default traffic flow 


002G_072 


How do you select the proper return path from AS 387 without 
using AS-path prepending in AS 213? 
Use local preference in AS 387 


Will the administrator of AS 387 configure it? 
Unlikely 


inc. Alll rights reserved BGP v3.1—4-3 


In this example, the customer and the backup service provider would like to avoid AS-path 
prepending and rely on other BGP tools to properly route the return traffic over the highest- 
speed WAN link. 


Using the MED to influence the preferred return path is not possible because the MED cannot 
be propagated across several autonomous systems. AS 387 would, therefore, receive networks 
from AS 213 directly with the MED attribute, but without a MED attribute from AS 462. In any 
case, BGP route selection would be based on the length of the AS path, and even if the MED 
was present and used the shortest path, it would still be through the slow 64-kbps link. 


The only option for solving this issue is to use local preference in AS 387. The problem with 
this solution is that service providers normally do not rush to implement every wish that their 
customers might have. 


This lesson describes a solution to this case study that uses the transitive optional attribute 
called “BGP community” in conjunction with local preference. 
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BGP Communities Overview 


4-86 


This topic describes the basic properties and fundamental qualities of BGP communities. 


BGP Communities Overview 


* BGP communities are a means of tagging 
routes to ensure consistent filtering or route 
selection policy. 


¢ Any BGP router can tag routes in incoming 
and outgoing routing updates or when doing 


redistribution. 


¢ Any BGP router can filter routes in incoming or 
outgoing updates or select preferred routes 
based on communities. 


° By default, communities are stripped in 
outgoing BGP updates. 


A community is an attribute that is used to tag BGP routes. A router can apply it to any BGP 
route by using a route-map. Other routers can then perform any action based on the tag 
(community) that is attached to the route. 


There can be more than one BGP community that is attached to a single route, but the routers, 
by default, remove communities in outgoing BGP updates. 
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BGP Communities Overview (Cont.) 
———————————— er rn eNotes 


° The community attribute is a transitive 
optional attribute. Its value is a 32-bit number 
(range 0 to 4,294,967,200). 


¢ Each network in a BGP routing table can be 
tagged with a set of communities. 


¢ The standards define several filtering-oriented 
communities: 


— no-advertise: Do not advertise routes to any peer 

— local-as: Do not advertise routes to any EBGP peers 

— no-export: Do not advertise routes to real EBGP peers 
— internet: Advertise this route to the Internet community 


° Routers that do not support communities pass 
them along unchanged. 


The community attribute is a 32-bit transitive optional attribute that provides a way to group 
destinations and apply routing decisions (accept, prefer, redistribute, and so on) according to 
communities. A set of community values has been predefined. When a router receives a route 
that has been marked with a predefined community, it will perform a specific, predefined action 
that is based on that community setting as follows: 


= no-advertise: If a router receives an update carrying this community, it will not forward it 
to any neighbor. 


 local-as: This community has a similar meaning to no-export, but it keeps a route within 
the local AS (or member-AS within the confederation). The route is not sent to external 
BGP neighbors or to intra-confederation external neighbors. 


™ no-export: If a router receives an update carrying this community, it will not propagate it 
to any external neighbors except intra-confederation external neighbors. This is the most 
widely used predefined community attribute. 


m™ internet: Advertise this route to the Internet community. All routers belong to it. 


Routers that do not support the community attribute will pass the attribute to other neighbors 
because it is a transitive attribute. 
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BGP Communities Overview (Cont.) 
———————————— ee en eee 


Defining your own communities 
° A 32-bit community value is split into two parts: 


—High-order 16 bits contain the AS number of the 
AS that defines the community meaning. 


—Low-order 16 bits have local significance. 


° Values of all zeroes and all ones in high-order 16 
bits are reserved. 


* Cisco IOS parser allows you to specify a 32-bit 
community value as: 


—[AS-number]:[low-order-16-bits] 


Community attributes are usually used between neighboring autonomous systems. In order for 
the BGP communities to be globally unique, a public AS number should be part of the 
community value. For this reason, you can enter the community value as two 16-bit numbers 
separated by a colon. The first number (high-order 16 bits) should be the AS number of the AS 
that defines the community value, and the second number should be a value that is assigned a 
certain meaning (that is, translation of a community value into local preference in the 
neighboring AS). 


Communities can also be used internally within an AS (to ensure AS-wide routing policy) in 
which case the first 16 bits should contain the AS number of the local AS. 
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Using Communities 


This topic describes how BGP communities can facilitate proper return path selection. 


Using Communities 


¢ Define administrative policy goals. 


* Design filters and route selection policy to 
achieve administrative goals. 


¢ Define communities that signal individual goals. 


¢ Configure route tagging on entry points or let 
BGP neighbors tag the routes. 


¢ Configure community distribution. 


¢ Configure route filters and route selection 
parameters based on communities. 


Designing a BGP solution around BGP communities usually requires the following steps: 
Step 1 Define administrative policy goals that you need to implement. 

Step 2 Define the filters and route selection policy that will achieve the required goals. 
Step 3 Assign a community value to each goal. 


Step 4 Apply communities on incoming updates from neighboring autonomous systems or 
tell the neighbors to set the communities themselves. 


Step 5 Enable community distribution throughout your AS to allow community 
propagation. 


Step 6 Match communities with route-maps and route filters, change BGP attributes, or 
influence the route selection process based on the communities that are attached to 
the BGP routes. 
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Example 


Using Communities (Cont.) 


Define administrative policy goals. 

* Solve asymmetrical customer routing problems. 
Design filters and path selection policy to 
achieve administrative goals. 


¢ Set local preference of customer routes to 50 for 
customers using the backup ISP. 


Define communities that signal individual goals. 


* Community 387:17 is used to indicate that the local 
preference of the route should be lowered to 50. 


The following table is an example of how you can define goals and assign communities to 


them. 
Goal Community Value 
Set local preference of 50 387:17 
Set local preference of 150 387:18 
Prepend AS path once when sending the 387:21 


network to external neighbors 


Prepend AS path twice when sending the 387:22 
network to external neighbors 


Prepend AS path three times when sending the 387:23 
network to external neighbors 


All customers of the service provider should know this list so that they can use the BGP 
communities without having to discuss their use with the service provider. 
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Configuring BGP Communities 


This topic lists the steps that are required to successfully deploy BGP communities in a BGP- 
based network. 


Configuring BGP Communities 


Configure BGP communities in the following 
steps: 

* Configure route tagging with BGP communities. 

¢ Configure BGP community propagation. 


¢ Define BGP community access-lists (community- 
lists) to match BGP communities. 


* Configure route-maps that match on community- 
lists and filter routes or set other BGP attributes. 


* Apply route-maps to incoming or outgoing 
updates. 


BGP v3.1—4-9 


Configuration steps when you are using communities include the following: 
m Setting communities, which requires a route-map. 


m Enabling community propagation per neighbor for all internal neighbors. If communities 
are sent to external neighbors, you must enable community propagation for external 
neighbors. 


m™ Creating community-lists to be used within route-maps to match on community values. 


m™ Creating route-maps where community-lists are used to match on community values. You 
can then use route-maps to filter based on community values or to set other parameters or 
attributes (for example, local preference, MED, or AS-path prepending). 


m= Applying route-maps to incoming or outgoing updates. 
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Configuring Route Tagging with BGP 
Communities 


This topic lists the Cisco IOS commands that are required to configure route tagging with BGP 
communities. 


Configuring Route Tagging with 


BGP Communities 
SN Cisco'co maa 


router (config) # 


route-map name 
match condition 
set community value [ value .. ] [additive] 


* Route tagging with communities is always done with 


a route-map. 
¢ You can specify any number of communities. 


* Communities specified in the set keyword overwrite 
existing communities unless you specify the additive 
option. 
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In a route-map configuration mode, you should use the set community command to attach a 
community attribute (or a set of communities) to a route. You can attach up to 32 communities 
to a single route with one route-map set statement. If the keyword additive is used, the original 
communities are preserved and the router simply appends the new communities to the route. 
Omitting the additive keyword results in overwriting any original community attributes. 
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Configuring Route Tagging with 


BGP Communities (Cont.) 
_————————— nn Cairns 


router (config-router) # 


neighbor ip-address route-map map in | out 


¢ Applies a route-map to inbound or outbound BGP 
updates. 


* The route-map can set BGP communities or other 
BGP attributes. 


router (config-router) # 


redistribute protocol route-map map 


¢ Applies a route-map to redistributed routes. 
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You can apply a route-map to incoming or outgoing updates. You can also use it with 
redistribution from another routing protocol. 


Note A route-map is a filtering mechanism that has an “implicit deny” for all networks that are not 
matched in any route-map statement. If a route-map is not intended to filter routes, then you 
should add another route-map statement at the end to permit all remaining networks without 
changing it (no match and no set commands are used within that route-map statement). 


Originally, Cisco IOS software accepted and displayed BGP community values as a single 32- 
bit value in a digital format. Newer Cisco IOS versions support the new format, where you can 
set or view a community as two colon-separated 16-bit numbers. 


The global command ip bgp-community new-format is recommended on all routers whenever 
communities contain the AS number. 


After being converted, configuration files with communities in the new as:nn format are not 
compatible with older versions of Cisco IOS software. The text here shows the difference in 
appearance between the old and new formats: 

router# show ip bgp 6.0.0.0 

Community: 6553620 

After the “ip bgp-community new-format” command 


router# show ip bgp 6.0.0.0 


Community: 100:20 
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Example 


4-94 


Configuring Route Tagging with 


BGP Communities (Cont.) 


ee Cn eT 


Desired traffic flow 


10.0.0.0/8 


Default traffic flow 


router bgp 213 
neighbor 1.2.3.4 
neighbor 1.2.3.4 
neighbor 1.2.3.4 
! 

route-map setcomm 


set community 387: 


remote-as 387 
route-map setcomm out 
send-community 


In this example, a border router in AS 213 applies a community value of 387:17 to all networks 
that are sent to neighboring AS 387. In this example, another route-map entry is not needed 
because the first statement permits all networks (no match command means “match all”). 


If it is more desirable to set communities on specific routes, you can use a standard access 
control list (ACL) to match against, with the match ip address command in the route-map. 


In a later example, networks with community 387:17 will have the local preference changed to 
a value of 50 within AS 387 to force AS 387 to prefer the other path that carries the default 


local preference of 100. 
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Configuring Community Propagation 


This topic lists the Cisco IOS command that is required to enable BGP community propagation 
to BGP neighbors. 


Configuring Community Propagation 
a ( 


router (config-router) # 


neighbor ip-address send-community 


° By default, communities are stripped in outgoing 
BGP updates. 


* You must manually configure community propagation 


to BGP neighbors. 


* BGP peer groups are ideal for configuring BGP 
community propagation toward a large number of 
neighbors. 
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A command that is commonly forgotten by network administrators when configuring BGP 
communities is neighbor ip-address send-community. This command is needed to propagate 
community attributes to BGP neighbors. Even if you use an outgoing route-map to set 
communities, by default, the router will strip out any community values that are attached to 
outgoing BGP updates if you have not configured this command for the specific BGP neighbor. 


You can also apply this command to a peer group. 
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Example 


Configuring Community Propagation (Cont.) 


Desired traffic flow 


10.0.0.0/8 


Default traffic flow 


router bgp 213 

neighbor 1.2.3.4 remote-as 387 
neighbor 1.2.3.4 route-map setcomm out 
neighbor 1.2.3.4 send-community 

! 

route-map setcomm permit 10 

set community 387:17 


0026_074 
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The configuration example that was discussed earlier in this lesson must include the send- 
community command to enable community propagation from AS 213 to AS 387. 
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Defining BGP Community-Lists 


This topic lists the Cisco IOS commands that are required to match routes based on attached 
BGP communities using community-lists. 


Defining BGP Community-Lists 
Cisco.com 


router (config) # 


ip community-list 1-99 permit|deny value [ value .. ] 


* Defines a simple community-list. 
* Community-lists are similar to access-lists—they are 


evaluated sequentially, line by line. 


¢ All values listed in one line have to match for the line 
to match and permit or deny a route. 


¢ You can use the keyword internet to match any 
community. 
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You can use a standard community access-list to find community attributes in routing updates. 
A standard community-list is defined by its assigned list number, which ranges from 1 to 99. 
Community-lists are similar to standard IP access-lists in the following ways: 


m= The router evaluates the lines in the community-list sequentially. 


m Ifno line matches communities that are attached to a BGP route, the route will be 
implicitly denied. 


Standard community-lists are different from standard IP access-lists in the following ways. 


m The keyword internet should be used to permit any community value. 


m= If more values are listed in a single line, they all have to be in an update to have a match. 
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Defining BGP Community-Lists (Cont.) 
ee Sapa | 


router (config) # 


ip community-list 100-199 permit|deny regexp 


° Defines an extended community-list. 
¢ Extended community-lists are like simple community- 


lists, but they match based on regular expressions. 


* Communities attached to a route are ordered, 
converted to string, and matched with regexp. 


° Use .* to match any community value. 
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An extended community-list is defined by its assigned list number, which ranges from 100 to 
199. Regular expressions are used to match community attributes. When a router processes a 
list of communities that are attached to a network update, they are converted into an ordered 
string of characters. The example below shows how this process is accomplished: 


1. The original list of communities in an update: 


“10.0.0.0/8, NH=1.1.1.1, origin=I, AS-path=20 30 40, community=10:101, 
community=10:201, community=10:105, community=10:205” 


2. A string of characters containing an ordered list of community values: 


“—10:101_10:105_10:201_10_205_” (“_” represents a space) 


3. A regular expression: 


“permit _10:.0[1-5]_” (“_” represents an underscore that matches spaces) 


4. The result: 


This regular expression permits the route because it permits all routes with communities 
where the first 16 bits carry the AS number 10 and the second 16 bits contain 0 as the 
second digit and a number between 1 and 5 as the third digit; the first digit can be anything 
(as indicated by the “.”). 


Use regular expression “.*” to permit any community. 
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Example 


Defining BGP Community-Lists (Cont.) 


Desired traffic flow 


10.0.0.0/8 


Default traffic flow 


! Match the community that signals 
! reduced local preference 
! 


ip community-list 7 permit 387:17 
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This example shows a portion of the configuration of the router in AS 387. The access-list has 
been configured to match communities that were previously set by the router in AS 213. 
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Matching BGP Communities with Route-Maps 


This topic lists the command that is required to match routes based on attached BGP 
communities using route-maps. 


Matching BGP Communities with Route-Maps 
Rf 


router (config) # 


route-map name permit | deny 
match community clist-number [exact] 
set attributes 


Community-lists are used in match conditions in route- 


maps to match on communities attached to BGP routes. 


A route-map with a community-list matches a route if at 
least some communities attached to the route match the 
community-list. 


With the exact option, all communities attached to the 
route have to match the community-list. 


You can use route-maps to filter routes or set other BGP 
attributes based on communities attached to routes. 
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Network administrators use route-maps to match networks that carry a subset of communities 
that are permitted by the community-list. Other parameters or attributes can then be set based 
on community values. If you use the keyword exact, all communities that are attached to a 
BGP route have to be matched by the community-list. 
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Matching BGP Communities with Route-Maps 


(Cont.) 
eee Cisco.com | 


Route Selection 


* You can use route-maps to set weights, local 
preference, or metric based on BGP communities 
attached to the BGP route. 


¢ Normal route selection rules apply afterward. 
¢ Routes not accepted by route-map are dropped. 


Default Filters 


* Routes tagged with community no-export are sent to 
IBGP peers and intra-confederation EBGP peers. 


* Routes tagged with local-as are sent to IBGP peers. 


* Routes tagged with no-advertise are not sent in any 
outgoing BGP updates. 
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You can use a route-map to filter or modify BGP routing updates. Any BGP-related set 
commands can be used to set BGP parameters and attributes (that is, weight, local preference, 
MED). 


As mentioned before, there are some predefined community values that cause routers to 
automatically filter routing updates: 


= no-advertise: If a router receives an update carrying this community, it will not forward it 
to any neighbor. 


m local-as: This community has a similar meaning to no-export, but it keeps a route within 
the local subautonomous system. It is not sent to intra-confederation external neighbors or 
to any other external neighbors. 


™ no-export: If a router receives an update carrying this community, it will not propagate it 
to any external neighbors except to intra-confederation external neighbors. 


m™ internet: Advertise this route to the Internet community. All routers belong to it. 
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Example 


Matching BGP Communities with Route-Maps 


(Cont.) 
eee Cisco.com | 


AS 213 Desired traffic flow 
2 Mbps 


10.0.0.0/8 
64 kbps 


Default traffic flow 


router bgp 387 

neighbor Customers peer-group 

neighbor Customers route-map setlocpref in 
! 

route-map setlocpref permit 10 

match community 7 

set local-preference 50 

! 


route-map setlocpref permit 9999 
! 


ip community-list 7 permit 387:17 
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This example shows a configuration that translates community 387:17 into local preference 50. 
All updates that are received from neighboring AS 213 are processed by the route-map, which 
uses a community-list to find community 387:17. If the community-list matches one of the 
community attributes, the set command is executed and the route is permitted. If the route does 
not contain the right community, it is simply permitted by route-map statement 9999 without 
changing anything in the update. 


The result is that AS 387 prefers other paths to AS 213 because they have a default local 
preference of 100. 
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Monitoring Communities 


This topic lists the commands that are required to monitor BGP communities. 


Monitoring Communities 


* Communities are displayed in show ip bgp prefix 
printout. 


* Communities are not displayed in debugging 
outputs. 


¢ Routes in BGP table tagged with a set of 
communities or routes matching a community-list 
can be displayed. 


Because a community is an attribute that can appear more than once in a single update, the 
show ip bgp command does not show it. You can view communities only if you use the show 
ip bgp prefix command. 


If you use the show ip bgp community-list command, all networks that are permitted by the 
community-list are listed. 
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Monitoring Communities (Cont.) 


* Communities are displayed only in show ip bgp prefix 


printout. 
Communities attached to 
the route in BGP table | — 
Betty#show ip bgp 10.0.0.0 


BGP routing table entry for 10.0.0.0/8, version 17 
Paths: (3 available, best #3, advertised over EBGP) 
213 
143.072 from 1.3.0.2: (10.2411) 
Origin IGP, metric 0, localpref 50, valid, external 
Community: 387:17 
213, (received-only) 
1.3.0s2 from 1.3.0.2 (10.1,.1.1) 
Origin IGP, metric 0, localpref 100, valid, external 
Community: 387:17 
462 213 
LO. & trom ThO.8 (12.2. 2739 
Origin IGP, localpref 100, valid, external, best 


002G_077 


Communities received 
from the neighbor 
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This example shows the output of the show ip bgp prefix command where inbound soft 
reconfiguration was enabled on one of the neighbors. The original update contained one single 
community attribute (387:17), which can be seen from the second path marked with “received- 
only.” This update was then processed by an inbound route-map, which matched the 
community 387:17 and changed the local preference of the received route to 50. 
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Monitoring Communities (Cont.) 


router> 


show ip bgp community 


* Displays all routes in a BGP table that have at least 
one community attached 


router> 


show ip bgp community as:nn [as:nn ...] 


* Displays all routes in a BGP table that have all the 
specified communities attached 
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Another use of the show command is to filter the output of show ip bgp. 


If the keyword community is included, all networks that have at least one community attribute 
are displayed. 


If the keyword community is followed by one or more community values, only those networks 
that carry all those communities are displayed. 
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Monitoring Communities (Cont.) 


router> 


show ip bgp community as:nn [as:nn ..] exact 


* Displays all routes in BGP table that have exactly the 
specified communities attached 


router> 


show ip bgp community-list clist 


* Displays all routes in BGP table that match 
community-list clist 


BGP v3.1—4-24 


If the keyword community is followed by one or more community values, only those networks 
that carry all those communities are displayed. If the keyword exact is added at the end, only 
those that match exactly are displayed. 


You can also use a community-list to filter the output of the show ip bgp command. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
ee Cicero = | 


* You can use the BGP community attribute to create an 
AS-wide routing policy or to provide services to 
neighboring autonomous systems. 


Community attributes are usually used between 
neighboring autonomous systems. Routers that do not 
support the community attribute will pass the attribute to 
other neighbors because it is a transitive attribute. 


A community is an attribute that is used to tag BGP 
routes that you can use to manipulate path selection and 
enforce administrative policies. 


* To set the community attribute, you must use a route- 
map. 


In route-map configuration mode, you should use the set 
community command. 


Summary (Cont.) 


* You must configure propagation of BGP 
communities on the routers on a per-neighbor basis; 
otherwise, the BGP communities are removed from 
the outgoing BGP updates. 


* You can use community-lists to match against the 
community attribute as a method of route selection. 


* Aroute-map is used to match networks that carry a 
subset of communities that are permitted by the 
community-list. 


* You can view communities only if you use the show ip 
bgp prefix command. 
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References 


For additional information, refer to these resources: 


m= For information on BGP communities, refer to “BGP Case Studies” at the following URL: 
http://www.cisco.com/warp/public/459/bgp-toc.html#communityattribute 


m For further information on BGP communities, refer to “Configuring BGP” at the following 
URL: 
http://www.cisco.com/univercd/cc/td/doc/product/software/ios120/12cgcr/np1_c/1cprt1/1c 
bgp.htm#xtocid34 


Next Steps 


For the associated lab exercise, refer to the following section of the course Lab Guide: 


m Lab Exercise 4-4: Addressing BGP Communities 
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Lesson Assessments 


Overview 


Use the lesson assessments here to test what you learned in this module. The correct answers 
and solutions are found in the Lesson Assessment Answer Key. 


Outline 


This section includes these assessments: 


Quiz 4-1: Influencing BGP Route Selection with Weights 
Quiz 4-2: Setting BGP Local Preference 

Quiz 4-3: Using AS-Path Prepending 

Quiz 4-4: Understanding BGP Multi-Exit Discriminators 
Quiz 4-5: Addressing BGP Communities 
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Quiz 4-1: Influencing BGP Route Selection with 
Weights 


Complete this quiz to assess what you learned in the lesson. 


Objectives 
This assessment tests your knowledge of how to: 
m= List BGP route selection criteria 
m™ Describe the use of BGP weights to influence the BGP route selection process 
m= Influence the BGP route selection process by configuring per-neighbor weights 
m™ Influence the BGP route selection process by configuring BGP weights with route-maps 


m Identify the Cisco IOS commands that are required to monitor BGP route selection and 
weights 


= Summarize BGP route selection and filtering tools 
Quiz 
Answer these questions: 


Q1) What is the difference between local preference and weight? 


A) Local preference has a higher priority in BGP path selection. 


B) Local preference is used AS-wide while weight is local to a single router. 
C) Local preference is local only to a specific BGP-speaking router. 
D) Local preference is used to influence incoming path selection. 


Q2) What is the default weight for routes that are received from a BGP neighbor? 


A) 0 
B) 100 
C) 32768 


D) depends on the Cisco IOS release 


Q3) | When are the weights that are configured on a neighbor enforced? 


A) Before the new weights can take effect, the BGP process on the router must be 
removed and reconfigured. 

B) The router must first be rebooted for the new weights to take effect. 

C) The new weights will be applied after the BGP update interval of 30 minutes 
expires. 

D) The new weight configuration is applied to all routes that are received 


following the configuration change. 


Q4) How could you implement a primary/backup ISP routing policy by using weights? 


A) assign higher weights to all routes that are received from the backup ISP 
B) assign lower weights to all routes that are received from the backup ISP 
C) assign higher weights to all routes that are received from the primary ISP 
D) assign lower weights to all routes that are received from the primary ISP 
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Q5) — When you are using route-maps to modify weights, what happens by default to a route 
that does not match any of the route-map statements? 


A) The route is accepted with the weight attribute unmodified. 

B) The route is discarded. 

C) The route is inserted into the BGP table but not the IP routing table. 
D) An error is displayed on the router console and in router debugs. 


Q6) = Which method of influencing route selection with weights is the last to be applied on 
an incoming interface? 
A) prefix-list 
B) route-map 
C) filter-list weight 
D) default weight 


Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 4-2: Setting BGP Local Preference 


Complete this quiz to assess what you learned in the lesson. 


Objectives 
This assessment tests your knowledge of how to: 
m Explain why using BGP weights might not provide consistent BGP route selection in an AS 
m Describe how the BGP local preference attribute influences BGP route selection 


m Identify the Cisco IOS command that is required to configure default BGP local preference 
on a router 


m Identify the Cisco IOS commands that are required to configure BGP local preference 
using route-maps 


m Identify the Cisco IOS commands that are required to monitor BGP local preference 
Quiz 
Answer these questions: 


Q1) ~~ What is a key difference between the local preference and weight attributes? 


A) Local preference is local to the route on which it is configured. 
B) Local preference is local to the AS within which it has been configured. 
C) Local preference is local to the BGP administrative domain. 


D) Local preference is global to a BGP domain. 


Q2) What is the default value of local preference? 


A) 0 

B) 100 
C) 255 
D) 32768 


Q3) | Which command should you use to display locally applied local preference settings? 


A) show bgp preference detail 
B) show ip bgp 

C) show ip bgp detail 

D) show ip bgp prefix 


Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 4-3: Using AS-Path Prepending 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 


Quiz 


Describe the need to influence BGP return path selection in a service provider environment 


Describe the function of AS-path prepending and how you can use it to facilitate proper 
return path selection 


Identify design considerations when you are implementing AS-path prepending to 
influence return path selection 


Identify the Cisco IOS commands that are required to configure AS-path prepending in a 
multihomed network 


Identify the Cisco IOS commands that are required to monitor the operation of AS-path 
prepending 


Describe the concerns with using AS-path filters when neighboring autonomous systems 
require AS-path prepending 


Answer these questions: 


Q1) ~~ What is AS-path prepending? 
A) when a router, sending a BGP update, adds the AS number of the router from 
which it received the route, to the AS-path attribute 
B) when a router, sending a BGP update, adds the AS number of the router to 
which it is sending the route, to the AS-path attribute 
C) when a router, sending a BGP update, adds its AS number to the AS-path 
attribute multiple times 
D) when a router uses the AS-path attribute in route selection 
Q2) The AS path will be the route selection criterion that is used when which of the 
following is true? 
A) It is the first criterion that is used in BGP route selection. 
B) It is used when there is no difference in weight, local preference, or route 
origination. 
C) It is used when the multi-exit discriminator is identical on the candidate routes. 
D) The weight, local preference, MED, and origin attributes must be identical 
before the AS-path attribute is used for route selection. 
Q3) | Which command do you use to manipulate the AS-path attribute? 
A) the global configuration command set as-path prepend as-number 
B) the router configuration command set as-path prepend as-number 
C) set as-path prepend as-number in a route-map 
D) the interface global command set as-path prepend as-number 
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Q4) _ Given the following configuration from a router in AS 347, which is advertising 

network 11.0.0.0/8 to an EBGP neighbor 2.0.0.2 in AS 529: 

route-map addAS permit 10 

set as-path prepend 347 347 347 

router bgp 347 

neighbor 2.0.0.2 remote-as 529 
neighbor 2.0.0.2 route-map addAS out 

What are the contents of the AS-path attribute for route 11.0.0.0/8 on a router that is 

residing in AS 529? 

A) 347 347 347 

B) 347 347 347 347 

C) 529 347 347 347 

D) 529 347 347 347 347 

Q5) — Why do network administrators need to use AS-path prepending? 

A) AS-path prepending allows a customer to potentially influence return path 
route selection. 

B) AS-path prepending is used on a customer router to control outgoing route 
updates. 

C) Service providers use AS-path prepending to control incoming updates from a 
customer AS. 

D) AS-path prepending is used between service providers who are both connected 
to a customer AS to determine who will be the primary link to the customer. 

Q6) How does AS-path prepending affect a router? 

A) AS-path prepending is simply a term that is used to describe when a router uses 
the AS-path attribute in route selection and hence does not affect router 
resources. 

B) The longer the AS-path attribute attached to BGP updates, the more router 
memory requirements increase. 

C) AS-path prepending does not impact the router because Cisco IOS software 
recognizes that AS-path prepending is in use and stores a single AS number 
with a pointer to the number of AS-path prepends. 

D) AS-path prepending causes the router to operate in process-switching mode 
because the BGP update must be stored, manipulated, and then rewritten to 
accommodate the new AS-path attribute. 

Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 4-4: Understanding BGP Multi-Exit 
Discriminators 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 
m™ Describe how the MED can be used to facilitate proper return path selection 
m Describe MED propagation inside and between autonomous systems 


m Identify the Cisco IOS command that is required to configure the default BGP MED ona 
router 


m Identify the Cisco IOS commands that are required to configure the BGP MED using route- 
maps 


m Identify the Cisco IOS commands that are required to configure advanced MED properties 
m= Identify the Cisco IOS commands that are required to monitor the BGP MED 
m Identify the Cisco IOS commands that are required to troubleshoot the BGP MED 


Quiz 
Answer these questions: 


Q1) ~~ What is the typical application of the MED attribute? 


A) to influence path selection out of an originating AS 
B) to provide a strong metric to select the best path when multiple routes exist 
C) to have a BGP attribute traversing many autonomous systems while 


influencing path selection 
D) to influence the return path of traffic back into an AS 


Q2) What is the default value of the MED? 


A) 0 
B) 100 
C) 32768 


D) The MED is unused unless explicitly defined. 


Q3) What are three BGP attributes that are compared before the MED? (Choose three.) 


A) largest weight 

B) originated routes 
C) AS-path length 
D) lowest IP address 


Q4) _ If you configure inbound soft reconfiguration with a route-map and issue the show ip 
bgp prefix command, which value of the MED attribute is displayed? 


A) Only the original route (no MED) is displayed. 

B) Both the original route and the modified route are displayed. 

C) Only the modified route is displayed. 

D) The MED attribute is not displayed with the show ip bgp prefix command. 
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Scoring 


You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 4-5: Addressing BGP Communities 


Complete this quiz to assess what you learned in the lesson. 


Objectives 
This assessment tests your knowledge of how to: 
m Describe the issues of return path selection for multihomed customers 
m Describe the basic qualities of BGP communities 
m Describe how you can use BGP communities to facilitate proper return path selection 
m List the steps that are required to successfully deploy communities in a BGP-based network 


m Identify the Cisco IOS commands that are required to configure route tagging with BGP 
communities 


m Identify the Cisco IOS command that is required to configure BGP community propagation 


m Identify the Cisco IOS commands that are required to match routes based on attached BGP 
communities using community-lists 


m Identify the Cisco IOS command that is required to match routes based on attached BGP 
communities using route-maps 


m= Identify the Cisco IOS commands that are required to monitor BGP communities 
Quiz 
Answer these questions: 


Q1) — What are two reasons why it is not feasible to use the MED to influence return path 
selection when multiple autonomous systems are involved? (Choose two.) 


A) The MED attribute is designed to influence outbound path selection only. 

B) The AS-path attribute would be used for path selection regardless of any 
configured MED value. 

C) The weight attribute will always be used, given that it is first in the BGP route 
selection process. 

D) The MED cannot be propagated across several autonomous systems. 


Q2) Does the community attribute have any influence on BGP path selection? 


A) No, communities are simply tags that are applied to BGP routes. 

B) No, communities are nontransitive attributes. 

C) Yes, BGP paths are selected based on the value in the community tag. 
D) Yes, the community attribute is part of the BGP route selection process. 


Q3) | How many community tags can be attached to a single BGP route? 


A) 1 
B) 32 
C) 255 
D) depends on the number that is configured with the ip bgp community 
command 
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Q4) ~~ Which match criteria are specified in a standard BGP community-list? 


A) destination IP addresses 
B) regular expressions 
C) community attribute values 


D) AS numbers 


Q5) — What is the result of tagging a route with the no-export community? 


A) The route will not be advertised within the local AS. 

B) The upstream AS will not be allowed to export the route. 

C) The route cannot be exported to another routing protocol. 

D) The router will not propagate the route to any external neighbors except to 


intra-confederation external neighbors. 


Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Lesson Assessment Answer Key 
Quiz 4-1: Influencing BGP Route Selection with Weights 


Ql) oi 
Q2) A 
Q@3) OD 
Q4 CC 
Q5)  B 
Qs) B 
Quiz 4-2: Setting BGP Local Preference 
Ql) oi 
Q2) «iB 
Q@3) OD 
Quiz 4-3: Using AS-Path Prepending 
Ql) OC 
Q2) «iB 
Q3y) . 
Q4) ~B 
Q5) A 
Q6) B 


Quiz 4-4: Understanding BGP Multi-Exit Discriminators 


Q1) D 
Q2) A 
Q3) A,B,C 
Q4) B 


Quiz 4-5: Addressing BGP Communities 


Ql) B,D 
Q2) A 
Q3) B 
Q4) C 
Q5) D 
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Module 5 


Customer-to-Provider 
Connectivity with BGP 


Overview 


Today, many companies use the Internet for a variety of reasons, including increasing 
employee productivity, increasing sales, increasing customer satisfaction, and reducing cycle 
time. A key component in connecting companies to the Internet is the service provider. 
Depending upon business goals, application requirements, and administrative policies, a 
company will use different methods to connect to a service provider. Company business 
requirements and policies may even dictate that the company connects to multiple service 
providers. 


This module discusses the different requirements for connectivity between customers and 
service providers. Included in this module is a discussion of physical connection methods, 
redundancy, load balancing, and technical requirements such as addressing and autonomous 
system (AS) numbering. In addition, this module details the configuration requirements to 
comnect a customer to a single service provider by using static routes and the Border Gateway 
Protocol (BGP). Also provided in this module are the configuration requirements to connect a 
customer to multiple service providers by using BGP. 
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Module Objectives 


Upon completing this module, you will be able to describe the requirements for connectivity 
between customers and service providers using BGP. 


Module Objectives 


¢ Describe the requirements to connect customer 
networks to the Internet in a service provider 
environment 


¢ Implement customer connectivity by using static 
routing in a service provider network 


¢ Implement customer connectivity using BGP ina 
customer scenario where you must support multiple 
connections to a single ISP 


¢ Implement customer connectivity using BGP ina 
customer scenario where you must support 
connections to multiple ISPs 


BGP v3.1—5-2 


Module Outline 


The outline lists the components of this module. 


Module Outline 


* Understanding Customer-to-Provider Connectivity 
Requirements 


° Implementing Customer Connectivity Using Static 
Routing 


* Connecting a Multihomed Customer to a Single 
Service Provider 


* Connecting a Multihomed Customer to Multiple 
Service Providers 
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Understanding Customer-to- 
Provider Connectivity 
Requirements 


Overview 


Customers connect to the Internet by using service providers to enable different applications 
such as intranet connectivity with Virtual Private Networks (VPNs), extranet connectivity with 
suppliers, and other Internet applications. Different customers have different connectivity 
requirements depending upon their business model, redundancy requirements, and even 
network budget. 


This lesson discusses different solutions for connecting customer networks to service providers. 
Included in this lesson is a discussion of customer network redundancy requirements, routing 
requirements, IP addressing requirements, and AS numbering requirements. 


Relevance 


When planning network connectivity to a service provider, network designers must give careful 
consideration to the different aspects of the connectivity, including physical connection types, 
the redundancy provided by the connection method that is chosen, IP addressing requirements, 
and AS numbering considerations, if the network design is going to meet both the business and 
technical requirements of the applications that are planned for the network. 
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Objectives 


Upon completing this lesson, you will be able to describe the requirements that are used by 
customers to connect to service providers. This includes being able to meet these objectives: 


m Identify different physical connections that are used by customers to connect to a service 
provider 


m Describe the levels of redundancy that are provided by each physical connection type that 
is used by customers to connect to a service provider 


m= Identify different routing schemes that are used by customers to connect to a service 
provider 


m Describe routing schemes that are appropriate for each physical connection type that is 
used by customers to connect to a service provider 


m™ Describe the addressing schemes that are used by customers to connect to a service 
provider 


m Describe the AS numbering schemes that are used by customers to connect to a service 
provider 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
pe Siegen: = || 
* Overview 
* Customer Connectivity Types 
* Redundancy in Customer Connections 
* Customer-to-Provider Routing Schemes 


* Customer Routing 


* Addressing Requirements 
° AS Number Allocation 
¢ Summary 


5-4 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Customer Connectivity Types 


This topic identifies the different physical connections that are used by customers to connect to 
a service provider. 


Customer Connectivity Types 


Internet customers have a wide range of 
connectivity and redundancy requirements: 


* Single permanent connection to the Internet 


¢ Multiple permanent connections to a single 
provider in primary/backup configuration 


¢ Multiple permanent connections to a single 
provider used for load sharing of traffic 


* Connections to multiple service providers for 
maximum redundancy 


Service provider customers have different requirements for their Internet connectivity. These 
different requirements result in different solutions: 


m= A single permanent connection to one Internet service provider (ISP). This solution meets 
the requirements for the vast majority of customers. 


= Multiple permanent connections where one of the lines is primary and the other line is used 
for backup only. This setup also provides redundancy on the links. Compared to a dial-up 
backup, a permanent backup link is preferred for various reasons such as the severe 
bandwidth limitations on dial-up lines and the time that is required to establish a dial-up 
connection. 


= Multiple permanent connections to one ISP, which is used for load sharing of traffic. This 
solution gives redundancy on the links but also provides additional bandwidth. 


m Permanent connections to more than one ISP. This solution provides the highest level of 
redundancy, because it not only can cope with link-level failures but also failures within the 
network of a service provider. 
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Redundancy in Customer Connections 


This topic describes the different levels of redundancy that are provided by each physical 
connection type that is used by customers to connect to a service provider. 


Single Permanent Connection 
to the Internet 


Customer Customer Provider 
Router Edge Router Edge Router 


Customer Network Service Provider Network 


002G_259 


* The simplest setup: a single link between the 
customer network and the Internet 


* No redundancy for link or equipment failure 


A single permanent connection to one ISP is the most common setup. This setup is also the 
simplest to implement. 


The customer network has an edge router. This router is connected to one of the edge routers of 
the ISP. The connection is permanent and could be a leased line, a Frame Relay or ATM 
permanent virtual connection (PVC), a LAN segment, or something equivalent. 


There is no redundancy in this solution. Any failure on the permanent link or any of the two 
edge routers causes a complete outage of the service. Serious failures within the ISP network, 
which affect all customers of this ISP, also affect the customer in this example. 
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Multiple Permanent Connections 


Providing Redundancy 
(IS 


Customer Customer Provider 
Router Edge Router Edge Router 


we~ w~ 


Customer Provider 
Edge Router Edge Router 


Customer Network Service Provider Network 


Customers wanting increased redundancy install several physical 
links to the Internet. 


Redundant link is used in primary/backup setup or for load sharing. 
Redundancy for link or equipment failure. 
No redundancy for service provider failure. 


In this setup, one customer edge router connects to one ISP edge router. A different customer 
edge router is used to connect to another ISP edge router. If one of these routers fails, only one 
of the connections breaks down. The other connection is still available. 


In some cases, the two links may be implemented between the customer and the provider for 
load sharing and in other cases strictly for backup purposes. Backup PVCs in Frame Relay or 
ATM networks can sometimes be very cost-efficient, provided that these PVCs carry only a 
very small volume of traffic and that the primary path is available. 


In a case where load sharing between both links is a desired network characteristic, the 
distribution of the load over the links is more complicated when it is compared to a case where 
both links terminate in the same router. 


Again, because the customer is connected to a single ISP, serious ISP network failures, which 
affect all customers of this ISP, will also affect the customer in this scenario, regardless of the 
backup link. 
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Multiple Permanent Connections Providing 


Load Sharing 
eee Cisco.com | 


Customer Customer Provider 
Router Edge Router Edge Router 


Customer Network Service Provider Network 
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Customers wanting to increase their access speed can install 
several physical links between a pair of routers. 


Redundancy for link failure. 
No redundancy for equipment failure. 
Load sharing in this setup is optimal. 
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In the example here, a single router in the customer network is connected to a single router in 
the ISP network. The redundancy is limited to the link level because router failures are not 
covered. Using two parallel links between two routers allows for an optimal distribution of load 
over the links. 


Depending on the switching path that is used in the customer and the ISP routers, load sharing 
can be performed based on the destination address only (fast switching), based on source- 
destination address pairs (default behavior for Cisco Express Forwarding [CEF]), or ona 
packet-by-packet basis (process switching or CEF). 


As in the previous examples, serious ISP network failures that affect all customers of this ISP 
will also affect this customer, regardless of the link backup. 
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Connections to Multiple 
Service Providers 


—_ 


ee 


Customer Customer Provider . 
Router Edge Router Edge Router Service 
Provider A 


Customer Provider 


Customer Edge Router Edge Router Service 
Network . : Provider B 


Customers with maximum redundancy requirements install 
physical links to multiple Internet service providers. 


Redundancy for link, equipment, or service provider failure. 


Primary/backup setup is complex without service provider 
assistance. 


Good load sharing is impossible to achieve. 


Inc. Alll rights reserved 


In the example here, two different edge routers in the customer network have one permanent 
connection each to different ISPs. Link failures and router failures are covered by the 
redundancy in exactly the same way as in the example where the two customer routers are 
connected to two different routers in one ISP network. However, because the two connections 
in this example go to two different ISPs, the redundancy also covers problems within one ISP 
network. 


The two links may in some cases be implemented by the customer for load sharing and in other 
cases be used strictly for backup purposes. Controlling load distribution over the links is more 
complicated in this example. Avoiding any load on the backup link may require assistance from 
the ISP to which the backup link is connected. 


Load sharing between the links in this setup can never be optimal. Equal distribution of the 
return traffic load from the Internet over the two separate links cannot be done. Distribution of 
the load of outgoing traffic is done based on destination addresses. Slowly adjusting the 
appropriate router configuration parameters and observing the link traffic load changes that 
result can enable you to reach an acceptable distribution of router traffic between the two links. 
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Customer-to-Provider Routing Schemes 


This topic identifies different routing schemes that customers use to connect to a service 
provider. 


Customer-to-Provider Routing Schemes 
fC 


° Static or dynamic routing can be used 
between an Internet customer and an ISP. 


* BGP is the only acceptable dynamic 
routing protocol. 


* Because of its lower complexity, static 
routing is preferred. 


Different solutions for connecting a customer network to the network of an ISP require 
different methods of routing information exchange: 


m Static routing: Static routing is preferred because of its lower complexity. In a normal 
case, the customer network must have a default route to the ISP network and the ISP 
network must have a route to those IP prefixes that the customer has in its network. As 
always, static routing provides very low, if any, redundancy. 


= Dynamic routing: Dynamic routing provides redundancy. The customer and the ISP 
networks must be configured to exchange a common routing protocol. BGP is the only 
choice because of the large volumes of routing information, the inherent security 
mechanisms of BGP, and the ability of BGP to handle routing policies. 
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Customer Routing 


This topic describes routing schemes that are appropriate for each physical connection type that 


is used by customers to connect to a service provider. 


Customer Routing—Single Permanent 
Connection 


Customer Customer Provider 
Router Edge Router Edge Router 


Customer Network Service Provider Network 


° Static routing is usually adequate. 
¢ BGP should not be used in this setup. 


002G_259 


In a case where the customer has a single permanent connection to the Internet, static routing is 


usually adequate. The physical topology does not provide any redundancy, and it is therefore 
unnecessary to add the complexity of dynamic routing. Keep the network simple by avoiding 


the use of BGP in this case. 
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Customer-to-Provider Connectivity with BGP 
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Customer Routing—Multiple Connections 


Customer Customer Provider 
Router Edge Router Edge Router 


Customer Network Service Provider Network 
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° Static routing is preferred if physical link failure can 
be detected. 


° Traffic will enter a black hole if the physical link 
failure is not detected. 
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Multiple permanent connections between a single router on the customer network and a single 
router on the service provider network should be configured with static routing, provided that 
link failure can be detected by link-level procedures. 


With this type of connection, two static routes are configured on each network, pointing to both 
links between the customer and the ISP. If either of the links fails, the link-level procedures 
should detect this failure and place the interface in a down state. In this case, the static route is 
invalid and is not used for forwarding packets. The router will subsequently forward all packets 
over the remaining link. 


If the link-level procedures cannot detect a link failure, the static route pointing out over the 
failed link is still valid. The router continues to use this static route to send some of the traffic 
out on the failed interface. This situation effectively creates a black hole for some of the traffic. 
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Customer Routing—Multiple 
Connections (Cont.) 


—<——_ 


Customer Customer Provider 
Router Edge Router Edge Router 


“A 
—a 


Customer Provider 
Edge Router Edge Router 


Customer Network Service Provider Network 
¢ You can still use static routing if link and remote 
equipment failure can be detected reliably. 


* BGP between the customer and the service provider 
is usually used in this setup. 


You can also use static routing for multiple permanent connections between two different 
routers on the customer network to two different routers on the service provider network if the 
failures can be detected by the link-level procedures. When one of the connections is lost, the 
link-level procedure detects this loss and places the interface in a down state. Because the 
interface is in the down state, the static route, which points out of the down interface, becomes 
invalid. As a result, the router stops the redistribution of the static route into BGP. 


However, customers that require the use of multiple connections and multiple routers very 
often do not rely on the link-level procedures. These customers require a routing protocol such 
as BGP to detect the failures. Because BGP uses handshaking and reliable transfer, it always 
detects a failed link or failed remote router. 


Multiple permanent connections to more than one ISP always require the use of dynamic 
routing with BGP. The customers that require this type of connection do not just want to protect 
the network connectivity from link failures or remote router failures, they also want to protect 
their network connectivity from serious problems in the network of an ISP. 


Monitoring the link status cannot detect a problem inside one of the ISP networks. If the link is 
still up and the ISP edge router is still up, the link-level procedures do not indicate any 
problems. However, the ISP network may suffer from severe problems. An ISP network can be 
partitioned or disconnected from the rest of the Internet without having any problems with the 
edge router and the access line to the customer network. 


The only way to detect this situation is to use BGP with both ISPs and receive full Internet 
routing from both of them. When one of the ISPs has problems, the edge router, being the BGP 
neighbor of the customer, withdraws those routes that it can no longer reach. This action means 
that the customer routers know which Internet routes that each ISP can reach at the moment. 
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Addressing Requirements 


This topic describes the different addressing schemes that customers use to connect to a service 
provider. 


Addressing Requirements—Single-Homed 


Customers 
_——————— en EE mnCIScotcomams sans 


Customers connected to a single service 
provider usually get their address space from 
the provider. 


* Provider-assigned (PA) address space. 


e Most common customer setup. 


¢ Customer has to renumber if service provider 
changes. 


Customer gets only a small address block from 
the service provider. 
¢ Private addresses are used inside customer network. 
e NAT must be used. 


Customers that are connected to a single ISP usually get their address space assigned by the 
ISP. An ISP is usually assigned a large address space to delegate to its customers. Because all 
customers of one ISP get their addresses from one or a few address spaces, it is very likely that 
the ISP is able to aggregate the customer addresses before sending the routes to the rest of the 
Internet. 


Most customers are connected to a single ISP, which means that they are using provider- 
assigned (PA) addresses. If the customer should decide to change its service provider, the 
customer must return its PA addresses to the old ISP and receive a new assignment of PA 
addresses from the new ISP. Otherwise, the ISPs are no longer able to perform efficient address 
aggregation. 


The consequence for the customer is that the customer has to renumber its network when it 
changes its service provider. 


Some customers decide to use private addresses within their network and do Network Address 
Translation (NAT) at the connection point to the ISP. This setup means that customers require 
only a very small portion of public addresses from the ISP. In addition to conserving address 
space for the benefit of the Internet as a whole, this setup also means that when the customer 
decides to change its service provider, addresses are renumbered only at the NAT point. The 
rest of the customer network does not need to be renumbered. 


5-14 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Addressing Requirements—Multihomed 


Customers 
Cisco.com 


Customers connected to multiple service 
providers should get their own address space. 


¢ Provider-independent (PI) address space. 
¢ No renumbering required for service provider change. 


* Some service providers might not guarantee routing 
for small block (for example, /24) of PI space. 


Multihomed customers can sometimes use PA 
address space. 


¢ Must have a separate public AS number. 


* The provider must agree to having another ISP 
advertise its address space. 


Customers that are connected to more than one ISP should, if possible, assign their own address 
space and not have addresses that are delegated from any of their ISPs. Such assigned addresses 
are called provider-independent (PI). 


A customer using PI addresses can change its service provider without renumbering its 
network. The address space is not in any way bound to a particular provider. This arrangement 
means that no ISP can aggregate the customer routes before sending them to the rest of the 
Internet. The routes propagate through the Internet with the prefix lengths given. 


Some large ISPs filter out routes with long prefixes. ISPs do not want to populate their routing 
tables with a large number of explicit routes that should have been aggregated into a route 
summary before they were sent to them. As a result, the customer announcing small blocks of 
PI addresses, which cannot be aggregated, may not be reachable from all parts of the Internet. 
A larger block of PI addresses solves the problem. 


A multihomed customer can in some cases use PA addresses. The address space must be 
assigned from one of the ISPs. When the customer announces the block of PA addresses to both 
ISPs, both should propagate the addresses to the rest of the Internet. The provider that assigned 
the address space should also announce the larger block of addresses, of which the customer is 
announcing a subset. 


Other ISPs now receive two alternate explicit routes and an overlapping route summary. 
Filtering out explicit routes is more likely at this time because the other ISPs recognize these as 
routes that can be aggregated. If the other ISPs filter out the more explicit routes, the customer 
is still reachable as long as both providers are announcing the overlapping route summary. 
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Example 


5-16 


Addressing Requirements—Public and 
Private 


Network Address Translation 
(NAT) is performed at the firewall 


Customer Customer Provider 
Router Edge Router Edge Router 


"ee 


Customer irewe Customer Provider 
Router Edge Router Edge Router 


Customer 


Customer = Service Provider 
Network Network 


< Private addresses >< Public addresses > 
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In this example, the customer uses private addresses inside its own network. Only a very small 
network segment, called the customer demilitarized zone (DMZ), has been assigned public 
addresses. 


The customer network is connected to the customer DMZ using two alternate firewalls with 
both firewalls doing NAT. All packets leaving the customer network have their addresses 
translated to a public address belonging to the DMZ subnet. The reverse translation is made in 
the reverse traffic direction. 


In this case, the customer requires only a very small block of public addresses. These addresses 
can be PA addresses. If the customer decides to change its service provider, renumbering is not 
a problem because only a few devices need to be reconfigured by the customer. 


Care must be taken so that traffic flows symmetrically through the firewalls. Otherwise, NAT 
does not work. The easiest way to achieve this symmetry is to let only one firewall be active at 
a time. 
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AS Number Allocation 


This topic describes different AS numbering schemes that customers use to connect to a service 
provider. 


AS Number Allocation—Single-Homed 
Customers 


a > _Fs 
=~ 


Camel barra 


Customer Customer 
Router Edge Router 


Py 


a 


Customer 
Edge Router Edge Router 


AS 65001 
Customer Network Service Provider Network 


* Customers running BGP with the service provider need their 
own BGP AS number. 


* Private AS numbers (64512 - 65535) can be used for customers 
connected to a single service provider. 


BGP requires the use of AS numbers. When BGP is configured, the AS number is mandatory 
information. However, public AS numbers are a scarce resource. Customers should use public 
AS numbers only when they are required. A customer that uses BGP to exchange routing 
information with only one ISP does not require a public AS number. This customer can use a 
private AS number. 


An ISP network that is running BGP with some of its customers must determine whether a 
public or a private AS number is required for each customer. When the customer can use a 
private AS number, the ISP must allocate one from the range of private AS numbers (64512- 
65535). The ISP must make sure not to assign any of the private AS numbers to more than one 
customer. 


When the ISP receives BGP routes from the customer, the ISP routers see the private AS 
number in the AS path and treat the private number as any other AS number. However, before 
the ISP propagates any of these routes to the rest of the Internet, it must remove the private AS 
numbers from the AS path, because the same AS number may be in use by someone else. After 
the private AS number is removed, the route appears as belonging to the public AS of the ISP. 
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AS Number Allocation—Multihomed 
Customers 
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¢ Multihomed customers must run BGP with their 
service providers. 


¢ Multihomed customers must use public AS numbers 
for their autonomous system. 
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A multihomed customer requires a public AS number and must run BGP with both of its ISPs. 
The customer should not use a private AS number because both ISPs must propagate the 
customer routes to the rest of the Internet. If the customer does use a private AS number, and 
both ISPs remove the number before sending it to the rest of the Internet, then the customer 
routes will appear to be local in the public AS of both ISPs. To make BGP work correctly, 
multihomed customers need to avoid this situation. 


Note With the help of the AS number translation feature, private AS numbers can also be used for 


multihomed customers, but this type of configuration is not encouraged. 


Multihomed customers are correctly connected to the Internet by assigning a public AS number 
to the customer network. This public AS number appears in the AS path and should be 
propagated by the service provider to the rest of the Internet. The customer network is now 
reachable by the rest of the Internet through both providers. The route with the shortest AS path 
is used by Internet endpoints as the best route to the customer network. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
I SC 


° Different customers have different requirements for 
their Internet connections. These connectivity 
options include a single connection to a single ISP, 
multiple connections to the same ISP, and multiple 
connections to different ISPs. 


The least redundant, and most common, connection 
is a single permanent connection to a single service 
provider. Maximum redundancy can be achieved by 
connecting the customer network to two different 
ISPs. This setup safeguards against an ISP that has a 
serious problem within its own network. 


Depending upon the networking requirements of the 
customer, static or dynamic routing may be used 
when the customer connects to a service provider. 
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Summary (Cont.) 


* Customers that are connected to more than one ISP need 
to assign their own provider-independent (PI) address 
space and not have addresses that are delegated from 
any of their ISPs. 


Because public addresses are limited, private addresses 
are commonly used on private networks, and NAT is used 
to translate the private addresses to public for external 
connectivity. 


Whenever BGP is in use, an AS number is required. The 
customer does not need a public AS number if it is 
connected to a single ISP. The ISP can assign a private 
AS number in the range 64512-65535 to the customer and 
remove the information about that AS before the ISP 
propagates the customer routes to the rest of the 
Internet. A multihomed customer, however, requires a 
public AS number. 
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References 


For additional information, refer to these resources: 


m= For more information on connecting to a service provider, refer to “The Easy Guide to 
Selecting an Internet Service Provider” at the following URL: 
http://www.cisco.com/warp/public/cc/so/cuso/smso/crn/ezgd_pl.htm 


m= For more information on how NAT works, refer to “How NAT Works” at the following 
URL: 
http://www.cisco.com/en/US/tech/tk648/tk361/technologies_tech_note09186a0080094831. 
shtml 


m= For more information on configuring connections to service providers, refer to “Sample 
Configurations for Load Sharing with BGP in Single and Multihomed Environments” at the 
following URL: 
http://www.cisco.com/warp/public/459/40. html 
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Implementing Customer 
Connectivity Using Static 
Routing 


Overview 


Customers connect to the Internet using service providers to enable different applications such 
as intranet connectivity with VPNs, extranet connectivity with suppliers, and other Internet 
applications. Different customers have different connectivity requirements depending upon 
their business model, redundancy requirements, and even network budget. 


This lesson discusses static routing as a solution for connecting customer networks to service 
providers. Included in this lesson is a discussion of when static routing should be used between 
a customer and a provider, and how to configure static routing in nonredundant, backup, and 
load-sharing configurations. 


Relevance 


When a single connection to a service provider or multiple connections to the same service 
provider are the options that a customer has of connecting to the Internet, static routing is the 
simplest routing approach to implement between customer and provider. When network 
administrators are implementing customer-to-provider connectivity with static routes, it is 
important that they understand existing guidelines, as discussed in this lesson. Knowledge of 
static routing implementation guidelines will aid in successfully deploying static routing 
network configurations. 
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Objectives 


Upon completing this lesson, you will be able to explain customer connectivity using static 
routing. This includes being able to meet these objectives: 


Identify when to use static routing between a customer and a service provider in a BGP 
environment 


Describe the characteristics of static routing between a customer and a service provider in a 
BGP environment 


Identify design considerations for propagating static routes in a service provider network 
Configure static route propagation in a BGP environment with different service levels 


Configure a typical backup setup that uses static routing between a customer and a service 
provider in a BGP environment 


Describe the limitations of floating static routes when they are used in typical backup static 
routing scenarios and the corrective actions to overcome these limitations 


Describe the characteristics of load sharing when you are configuring static routing 
between a customer and a service provider 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


Outline 


Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


The outline lists the topics included in this lesson. 


Outline 


isc cory 


° Overview 

¢ Why Use Static Routing? 

° Characteristics of Static Routing 

* Designing Static Route Propagation ina 


Service Provider Network 


¢ Static Route Propagation Case Study 
Parameters 


* BGP Backup with Static Routes 

° Floating Static Routes with BGP 
* Load Sharing with Static Routes 
° Summary 


5-22 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Why Use Static Routing? 


This topic identifies when to use static routing between a customer and a service provider in a 
BGP environment. 


Why Use Static Routing? 
a ed 


Static routing is used for: 
* Customers with a single connection to the Internet 


* Customers with multiple connections to the same 
service provider in environments where link and 
equipment failure can be detected 


Dynamic routing with BGP must be used in all 
other cases. 
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Static routing is the best solution to implement when there is no redundancy in the network 
topology. A single connection between the customer network and the service provider network 
does not provide any redundancy. If the link goes down, the connection is lost regardless of 
what routing protocol is configured in the customer or provider network. When there are 
redundant connections between the customer network and the network of a single service 
provider, static routing can be used under specific circumstances. 


A static, default route must be conditionally announced by the customer edge routers that are 
using an Interior Gateway Protocol (IGP). If the link to one of the customer edge routers goes 
down, then the router must be able to detect the failure and invalidate the static default route. 
Announcement of this router as a default gateway that is using an IGP must now cease. 
Likewise, on the service provider edge routers, the static routes that are pointing to the 
customer networks must be invalidated if the link between them goes down, and redistribution 
to BGP is therefore stopped. 


If link-level procedures cannot detect a link failure, the interface remains in the up state. The 
static routes are not invalidated, and packets are forwarded into a black hole. In cases such as 
this one, because the router cannot detect a failure at the link level, BGP must be used between 
the customer and the provider. 


BGP must also be used between the customer and the service provider networks when the 
customer is multihomed. This is the case regardless of which link failure detection mechanisms 
are in use. 
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Characteristics of Static Routing 


This topic describes the characteristics of static routing between a customer and a service 
provider in a BGP environment. 


Characteristics of Static ReuHng 


Customer network must announce a default route. 


¢ Redistribute default route into customer IGP if the customer is 
running EIGRP. 


¢ Use default-information originate if the customer is running OSPF 
or RIP. 


Customer routes should be carried in BGP, not 
core IGP. 


° Redistribute static routes into BGP, not IGP. 


Routes to subnets of the provider address block 
should not be propagated to other autonomous 
systems. 

° Mark redistributed routes with no-export community. 

* Use static route tags for consistent tagging. 
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When static routing is implemented between the customer network and the ISP network, the 
edge router of the customer must announce itself as a default gateway or a gateway of last 
resort. This procedure must be done using the IGP within the customer network because 
different routers within the customer network must be able to select the best route to the exit 
point of the network. 


Different IGPs use different methods of announcing a router as a gateway of last resort. 
Enhanced Interior Gateway Routing Protocol (EIGRP) uses the concept of default network 
while Open Shortest Path First (OSPF) and Routing Information Protocol (RIP) send 
reachability information about network 0.0.0.0/0. In either case, the network operators of the 
customer network are responsible for configuring their network to use the customer edge router 
as a gateway of last resort. 


When static routing is used between the customer and the provider, the edge router of the 
provider must propagate a static route that points to the customer network, to all other routers 
within the ISP network, and also to the rest of the Internet. The network operators in the ISP 
network propagate the route using a configuration command to start redistributing the routes 
into BGP. 


Customer routes should not be redistributed into the IGP of the ISP network. Care should be 
taken that the IGP of the ISP network does not carry too many routes. Redistributing customer 
routes into the IGP could potentially cause poor performance and may eventually cause a 
complete shutdown of IGP routing at the service provider. 
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If a customer uses provider-assigned (PA) addresses and the ISP announces a large block of 
addresses for which the network of this customer is only a small portion of the block, then the 
routes of this customer should not be propagated by the service provider to the rest of the 
Internet. Instead, the rest of the Internet should receive only an announcement containing the 
larger block of addresses. 


An easy way of achieving this setup is to use communities within the ISP network. Any 
customer route that should not be announced to the rest of the Internet is marked using the no- 
export community. To ensure that the BGP communities get propagated, at least over all 
Internal Border Gateway Protocol (IBGP) sessions, the network operators of the ISP network 
must configure a send-community option for all IBGP neighbors. The edge routers of the ISP 
network then see the no-export community and filter those routes out before sending the update 
to External Border Gateway Protocol (EBGP) neighbors. 


Communities are set using route-maps. A route-map can select routes based on various 
attributes. One of these attributes is the route tag. Through configuration, a route tag can be 
assigned by the router to specific static routes. This option means that the network operators of 
the ISP network can invent a scheme of tagging where all static routes that should not be 
propagated to other autonomous systems are assigned a specific tag. Then a route-map can 
select all routes with that tag and assign them the no-export community. 
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Example 


Characteristics of Static Routing (Cont) 


Customer 
Edge Router 


Customer 
Router 


11.2.3.0/24 
Customer Network 


Provider 
Router 


Provider 
Edge Router 


AS 387 
Service Provider Network 


ip route 0.0.0.0 0.0.0.0 serial 0 
1 


router ospf 1 
default-information originate 


ip route 11.2.3.0 255.255.255.0 serial 0 
! 


router bgp 387 
redistribute static [route-map map] 


no auto-summary 


Default route is configured on the 
customer router 

Default route is redistributed into 
the customer network 


¢ Route for customer address space 
is configured on provider router 

* Customer route is redistributed 
into BGP 
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In the figure, the customer network is connected to the Internet by using a single permanent 
connection to a single service provider. In this case, a routing protocol does not add any 
redundancy and would only add complexity. 


The customer edge router has a static default route pointing to the interface serial 0. If the serial 
interface goes down, the route becomes invalid. The default-information originate command 
is configured in the OSPF process on the customer router; therefore, the router announces a 
default route into OSPF as long as it has a valid default route itself. 


The service provider edge router also has a static route, declaring the customer IP network 
number as reachable over the serial 0 interface. It also becomes invalid if the interface goes into 
the down state. The ISP edge router must forward this information to all other ISP routers and 
to the rest of the Internet. This action is accomplished by redistributing the static route into 
BGP. As long as the static route is valid, BGP announces it. To the rest of the Internet, the 
customer network appears as reachable within the AS of the ISP. As far as the rest of the 
Internet is concerned, the customer is a part of the service provider AS. 
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Designing Static Route Propagation in a Service 
Provider Network 


This topic identifies the design considerations for propagating static routes in a service provider 
network. 


Designing Static Route Propagation ina 
Service Provider Network 


° Identify all possible combination of services 
offered to a customer, including QoS services. 


* Assign a tag to each combination of services. 


¢ Configure a route-map that matches defined 


tags and sets BGP communities or other BGP 
attributes. 


° Redistribute static routes into BGP througha 
route-map. 


° For each customer, configure a static route 
toward the customer with the proper tag. 


You can easily extend the principle of using tags when you are configuring static routes, and of 
assigning different communities based on those tags, to implement a more complex routing 
policy: 


Identify all different service levels that are offered to customers and then all the different 
combinations of these service levels. 


You must assign each combination its own tag value and its own community. 


You must configure a route-map, which selects routes with each and every one of the 
assigned tags and sets the corresponding community value. Because the processing of a 
route-map stops when the match clause of a statement is met, each route should be assigned 
a single combination of communities only. Therefore, you must take great care to assign a 
tag and a community combination to each combination of services that are provided. 


When the provider edge routers redistribute static routes into BGP, these routes must pass 
through the route-map. BGP assigns the correct community depending on the tag values 
that are given on the configuration line for each of the static routes. 


Finally, you need to configure static routes. Before you configure a static route for a 
specific customer, you must identify the combination of the services that are provided to 
this customer. Then you must look up the corresponding tag value. After you have 
configured the route, you must assign the tag. 
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With this routing policy, every static route to a customer network is assigned a tag and the 
redistributed BGP route is assigned a corresponding community. The BGP communities that 


are attached to the routes signal to other routers in the ISP network which particular service 
combination that you should use. 
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Static Route Propagation Case Study Parameters 


This topic provides a scenario with varied service levels in which static route propagation is 
configured in a BGP environment. 


Static Route Propagation 
Case Study 


ee eS CUT as] 


Sample service offering 
Addressing 


» Provider-assigned address Advertise QoS Route Community 
blocks are not propagated to [etter maiean 713 Tag Values 
upstream ISPs Route 


* Provider-independent Normal no-export 
address blocks are 387:31000 
propagated to upstream ISP Normal 387:31000 


Quality of Service Gold no-export 
387:32000 


Gold 387:32000 


¢ Normal customers 
¢ Gold customers 


Define Static Route Tags 
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In this case study, the service provider offers two different service levels to its customers: 
Normal and Gold. Customers are also assigned IP address blocks. Some customers use PA 
addresses, which the ISP does not announce as explicit routes. The large route summary block 
announced by the ISP covers these customers. Other customers use PI addresses that must be 
explicitly announced to the Internet by the service provider. 


Because there are two different quality of service (QoS) services, Normal and Gold, and both 
PA and PI addresses, the total number of combinations to cover the network policy is four: 


Normal QoS routes that are assigned by the ISP and should not be explicitly announced 
Normal QoS routes that are PI routes and should be explicitly announced 
Gold QoS routes that are assigned by the ISP and should not be explicitly announced 


Gold QoS routes that are PI routes and should be explicitly announced 


Each of these four combinations receives its own tag value and its own community 
combination. 
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Static Route Propagation (Cont.) 


Configure Route-Maps 
————— rt een Fic, 


Customer Customer Provider Provider 
Router Edge Router Edge Router Router 


11.2.3.0/24 AS 387 
Customer Network Service Provider Network 


Tose aaa permit 10 Every combination of services offered to 
ee codes the customer has to be matched individually 
ee community no-export 387:31000 because of route-map limitations. 


route-map IntoBGP permit 20 
match tag 1001 


set community 387:31000 Do not insert permit all atthe end. 
! 


Only routes with proper tags are 
redistributed into BGP. 


BGP v3.1—5-8 


Network operators configure a route-map in the ISP edge router that has the static routes to the 
customer network. Redistribution of the configured customer static routes into BGP is also 
performed at the ISP edge router. 


Because a route-map can match an individual route in a single route-map statement only, a 
single tag value, representing each combination of services, must be assigned to the static 
routes by the router. When a route is matched, the interpretation of the route-map for that 
individual route stops. The route-map has one statement for each combination, and each 
statement matches a tag value and assigns the corresponding community combination for that 
tag. 


The route-map is applied during the redistribution of customer static routes into BGP at the 
provider edge router. Because the route-map has no “permit any” statement at the end, those 
static routes that are not assigned any of the tags being used are not redistributed. The route- 
map filters these routes out, forcing the network operators to make a tag assignment to all 
customer routes. Furthermore, the route-map filtering can help catch administrator 
configuration entry errors, thus giving each and every customer the service combination that 
they are entitled to. 
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Static Route Propagation (Cont.) 
Redistribution and Customer Routes 


Customer 
Router 


Customer 
Edge Router 


11.2.3.0/24 
Customer Network 


route-map IntoBGP permit 10 

match tag 1000 

set community no-export 387:31000 
' 
route-map IntoBGP permit 20 

match tag 1001 

set community 387:31000 


Normal customer (PA addressing), 
do not propagate address block. 


Provider 
Edge Router 


Provider 
Router 


AS 387 
Service Provider Network 


router bgp 387 

redistribute static route-map IntoBGP 
neighbor IBGP-neighbor send-community 
no auto-summary 

no synchronization 

! 


ip route 11.2.3.0 255.255.255.0 
serial1/0.2 tag 1000 
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This figure shows how the service provider edge router uses the route-map named “IntoBGP” 
when redistributing static routes into BGP. Because the route-map assigns community values 
that will be used by other routers within the ISP network, network operators must configure all 
IBGP neighbors with the send-community qualifier. 


Use the no auto-summary BGP configuration command to avoid having the subnet 
11.2.3.0/24 automatically summarized into 11.0.0.0/8. 


When connecting customers, the network operators identify which service combination to use 
for this particular customer. The three services associated with this particular customer are as 


follows: 
m Apply normal QoS 


@ Usea PA network number 


= Do not enable the provider to explicitly announce customer routes 


A static route to the customer is configured and assigned the appropriate tag value of 1000, 
which represents the specified services that are assigned to the customer. 
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Static Route Propagation (Cont.) 


Static Routes on the Provider Edge Router 


AS387# show ip route 11.2.3.0 Provider Provider 
Routing entry for 11.2.3.0/24 

Known, via’ vetatior’ distance 1, metric 0 Edge Router Router 
(connected) 

Tag 1000 

Redistributing via bgp 387 

Advertised by bgp 387 route-map IntoBGP 


Routing Descriptor Blocks: 
* directly connected, via Serial1/0.2 AS 387 


Route metric is 0, traffic share count is 1 Service Provider Network 


AS387# show ip bgp 11.2.3.0 
BGP routing table entry for 11.2.3.0/24, version 3 
Paths: (1 available, best #1, not advertised to EBGP peer) 
Local 
0.0.0.0 from 0.0.0.0 (1.0.0.2) 
Origin incomplete, metric 0, localpref 100, weight 32768, 
valid, sourced, best 
Community: 387:31000 no-export 
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The show ip route command displays information from the routing table about subnet 
11.2.3.0/24. The route is learned by static configuration and is redistributed via BGP. The 
router, through the use of a statically assigned tag, has assigned a tag value of 1000 to the 
customer route, and the route must pass through the route-map IntoBGP before being inserted 
into the BGP table. 


The show ip bgp command displays information from the BGP table about subnet 11.2.3.0/24. 
The route is local within this AS and is sourced by this router. The BGP communities 
387:31000 and no-export have been assigned by the router to the redistributed customer route 
by using the provider-defined route-map prior to inserting the customer route into the BGP 
table. 
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BGP Backup with Static Routes 


This topic explains how to configure a typical backup setup that uses static routing between a 
customer and a service provider in a BGP environment. 


BGP Backup with Static Routes 


© ey 
wa~~ 


Customer Provider Provider 
Router Router 


Customer Provider 
Backup Backup 


11.2.3.0/24 AS 387 
Customer Network Service Provider Network 


Floating static routes are redistributed 
into customer IGP and provider BGP 
after the primary link fails. 
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This example illustrates a case where the customer network has two connections to a single 
service provider. One connection between the customer network and the ISP is the primary 
connection, and the other connection is used for backup purposes only. If link-level procedures 
can detect link failures and a failure in the remote router, then static routing can be used instead 
of a dynamic routing protocol between the customer and provider networks. 


As in the previous example, where no backup link is available, the primary edge router of the 
customer has a static default route toward the ISP and the primary edge router of the ISP has 
static routes toward the customer. The customer router redistributes the static default route into 
its IGP. The ISP router redistributes the static routes into BGP. 


If the primary link goes down, the link-level procedures set the interface to the down state, 
causing the static routes pointing out through the interface to be invalid, and removing the 
routes from the routing table. When the interface changes back to the up state, the static route 
will reappear in the routing table. 


Redistribution of routes into any routing protocol is conditioned by the appearance of the route 
in the routing table. Thus, if the interface goes down, the router removes the static route from 
its routing table, and the route is withdrawn from the routing protocol. When the static route 
reappears, the redistribution process inserts it into the routing protocol again. 
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The backup edge router of the customer also uses a default static route toward the ISP, via the 
backup link. The backup edge router is also redistributing the default route into the IGP. 
However, the static route that is used is a floating static route, which is assigned a high 
administrative distance (AD), higher than the AD of the customer IGP. As long as the primary 
link works, the IGP provides the customer backup edge router with the primary default route. 
Because of the higher AD, the backup static default route is not installed into the backup router 
routing table. Because the static route is not in the routing table, it is not redistributed. If the 
primary link fails, the IGP no longer feeds the backup edge router with a default route. The 
backup static default route is the only remaining default route. Therefore, the router will install 
the floating default route into its routing table, and subsequently redistribute it into the IGP. 


The backup edge router of the ISP can also use floating static routes, which are redistributed 
into the ISP BGP process. 
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BGP Backup with Static Routes (Cont) 


Customer Configuration 


Customer Customer Provider Provider 
Router Primary Primary Router 


Customer Provider 
Backup Backup 


11.2.3.0/24 AS 387 
Customer Network Service Provider Network 


ip route 0.0.0.0 0.0.0.0 serial 0 
' 


router ospf 1 
default-information originate 


ip route 0.0.0.0 0.0.0.0 serial 0 250 
! 


router ospf 1 
default-information originate 
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In the figure, the customer network and the ISP network are connected using leased lines with 
High-Level Data Link Control (HDLC) encapsulation. Both the primary and the backup edge 
routers in the customer network have a static default route toward the serial interface leading to 
the ISP. Both routers also do redistribution of the default route into the OSPF protocol, which is 
being used as an IGP within the customer network. 


However, the static default route in the backup edge router is configured with an AD value set 
to 250. This AD value is higher than the AD values of any routing protocol. This configuration 
means that as long as the backup router receives the default route by OSPF, the static default 
route is not used. 


When the primary link goes down, the static default route in the primary router is not valid. The 
OSPF protocol stops announcing the default route, because the default-information originate 
command makes OSPF contingent on the availability of that static default route in the routing 
table before announcement. 


The backup router now installs its static default route in the routing table. The conditions for 
announcing the default route by OSPF are met and the rest of the customer routers see the 
backup router as the gateway of last resort. 
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BGP Backup with Static Routes (Cont.) 


Provider Configuration 


Customer Customer Provider Provider 
Router Primary Primary Router 


Customer Provider 
Backup Backup 


11.2.3.0/24 AS 387 
Customer Network Service Provider Network 


ip route 11.2.3.0 255.255.255.0 serial 0/0 tag 1000 250 
1 


router bgp 387 
redistribute static route-map IntoBGP 


Caveat: local BGP route is always better than an IBGP route. Floating static route 
is inserted into the BGP table and should not be removed from there 
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When floating static routes are configured on the provider edge routers, they are also 
redistributed into BGP. This configuration makes things a little bit more complicated. 


The network operator configures a floating static route to the customer subnet 11.2.3.0/24. In 
the provider edge router, the floating static route is assigned the same tag value as the tag value 
being used in the primary router. The route-map IntoBGP is the same as in the primary router 
and provides the routes to the customer network with the same communities (the same QoS 
level and indication whether to explicitly announce route prefix to the rest of the Internet). 


The floating static route is configured with an AD value of 250. This value is higher than any 
routing protocol. When the backup edge router of the ISP no longer receives any routing 
protocol information about the customer networks, the router will automatically install the 
floating static route and subsequently redistribute it into BGP. 


Based on BGP route selection rules, the redistributed floating static route will always remain 
the preferred path if additional BGP configuration is not performed on the provider edge router. 
This preference means that regardless of whether the primary link comes back, the backup 
router selects the locally sourced route as the best route. Therefore, the backup router continues 
to announce a path toward the customer network. The backup link does not go back to the Idle 
state. 
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BGP Backup with Static Routes (Cont) 


¢ The BGP table on service provider backup router 
contains the floating static route. 


AS387 Backup# sh ip bgp 11.2.3.0 
BGP routing table entry for 11.2.3.0/24, version 7 
Paths: (2 available, best #1, not advertised to EBGP peer) 
Advertised to non peer-group peers: 
10.3.0.5 
Local 
0.0.0.0 from 0.0.0.0 (10.3.0.6) 
Origin incomplete, metric 0, localpref 100, weight 32768, valid, 
sourced, best 
Community: 387:31000 no-export 
Local 
10.3.0.2 (metric 128) from 10.3.0.5 (1.0.0.2) 
Origin incomplete, metric 0, localpref 100, valid, internal 
Originator: 1.0.0.2, Cluster list: 10.3.0.5 
Community: 387:31000 no-export 


002G_314 
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In this example, the show ip bgp command is used in the backup edge router of the provider to 
display the information about the customer network 11.2.3.0/24. The primary link has come 
back, so the backup router now sees two alternate routes. The first route is the route that the 
router itself has redistributed into BGP using the floating static route. This route is locally 
sourced by this AS and has been assigned a weight value of 32768. The second route is the one 
that has been received by IBGP from the primary edge router. This AS also sources this route, 
but no weight value is assigned. 


The BGP route selection algorithm selects the route with weight value 32768 as the best. As a 
result, the route that was received from the primary edge router is not a candidate to be installed 
in the routing table and never competes with the floating static route. The floating static route 
stays in the routing table, and redistribution of the route continues until the backup link goes 
down and the route becomes invalid. 
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Floating Static Routes with BGP 


This topic describes the limitations of floating static routes when used in typical backup static 
routing scenarios and the corrective actions to overcome these limitations. 


Floating Static Routes with BGP 


Limitations and Corrections 
° Floating static routes do not work correctly with BGP. 


¢ Weight has to be lowered to default value in order for 
other BGP routes to be considered. 


¢ BGP local preference has to be changed for floating 
static routes redistributed into BGP, to make sure other 
routes take precedence. 


¢ Administrative distance cannot be matched witha 
route-map; additional tags need to be defined for static 
routes. 
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Unfortunately, floating static routes do not work correctly with BGP. After they are inserted, 
the floating static route is never removed from the routing table even if the primary link comes 
back. 


Whenever you use floating static routes in combination with redistribution into BGP, you will 
need to take additional configuration steps to ensure that the BGP route selection algorithm 
selects the primary route as the best BGP route when it reappears: 


m When a router redistributes a floating static route into BGP, the weight value assigned to 
the floating static route must be reduced. Otherwise, the floating static route will always be 
selected as the best BGP route after the first failure of the primary link occurs. 


= Local preference values must be also be assigned by the router to the floating static route so 
that the floating static route has a lower local preference than the primary route. This 
assignment ensures that the primary route is selected as the best BGP route after it comes 
back. 


These two requirements must be specified on the provider edge router in the route-map 
IntoBGP that is used for the redistribution. The route-map must select the floating static routes 
and set weight and local preference. However, a route-map cannot do matching based on the 
AD value that has been assigned to a static route. Some other means are required to make it 
possible for the route-map to distinguish between normal static routes that should have normal 
weight and local preference and the floating static ones that should have their values modified. 
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The solution is to create additional tag values for this set of static routes. The tag value must not 


only reflect the QoS level and whether to announce the route, but also the tag value must 


indicate if it is a primary route or a backup route. 


Floating Static Routes with BGP (Cont) 


Sample Static Route Tags with Backup 


Advertise Backup QoS Tag Community Local 
Customer Type Values Preference 
Route 


1000 no-export 100 
387:31000 


1010 no-export 
387:31000 
1011 387:31000 


no-export 
387:32000 
2010 no-export 
387:32000 
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Eight different tag values have currently been identified. Each of tag values indicates a specific 


combination of explicit route propagation (backup or primary) and QoS level. 


When network operators configure static routes in the provider edge router, they must consider 
which of the combinations that they should use for the route. The route-map that they use when 
redistributing the static routes into BGP must be configured to recognize all eight combinations 


and to set the appropriate weight, and community and local preference values. 
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Floating Static Routes with BGP (Cont) 


¢ The redistribution route-map needs to be updated on 
all provider edge routers. 


route-map IntoBGP permit 10 route-map IntoBGP permit 30 

match tag 1000 match tag 1010 

set community no-export 387:31000 set community no-export 387:31000 

set local-preference 100 set local-preference 50 

! set weight 0 

route-map IntoBGP permit 20 ! 

match tag 1001 route-map IntoBGP permit 40 

set community 387:31000 match tag 1011 

set local-preference 100 set community 387:31000 
set local-preference 50 
set weight 0 


002G_315 


Only the first half of the route map is displayed. 
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The configuration output in this figure displays the first half of the route-map IntoBGP. The 
output shows how four of the eight different tags are identified by match clauses. For each of 
the tag values, the route-map sets the community, the local preference, and, in some cases, the 
weight. 


Because the displayed half of the route-map deals only with those four tags that indicate QoS 
Normal, all statements in the configuration display have set the BGP community attribute to 
387:31000. The part of the route-map that is not shown deals with the four tags that indicate 
QoS Gold, which would be configured to set the BGP community attribute to 387:32000. 


Tag values of 1000, 1010, 2000, and 2010 indicate that the route should not be explicitly 
propagated. Those routes that should not be explicitly advertised by the provider to the rest of 
the Internet are assigned the no-export community by the route-map. 


Tag values 1010, 1011, 2010, and 2011 all indicate that the route is a backup route. Those tags 
have their weight value set to 0 and their local preference value set to 50. These settings ensure 
that upon the return of a failed primary route, the provider edge router will select the primary 
route as its best path and remove the backup floating static route from its route table. 
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Load Sharing with Static Routes 


This topic describes the characteristics of load sharing when you are configuring static routing 
between a customer and a service provider. 


Load Sharing with Static Routes: 
Outgoing Traffic 


Customer Customer Provider Provider 
Router Edge Router Edge Router Router 


se 2 - a F ~~ F 


Lea : ws & wer ad 


Customer Customer Provider Provider 
Router Edge Router Edge Router Router 


Customer Network Service Provider Network 


Outgoing traffic load sharing is easy to achieve. 


Each customer router uses the closest customer edge router as 
the exit point. 


Balanced load sharing is achieved if the customer edge routers 
are collocated. 
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Load sharing of outgoing customer traffic is accomplished by configuring a standard default 
static route in both customer edge routers. Each static route is valid as long as the serial link in 
each router is up. When both static routes are valid, both customer edge routers announce the 
default route into the customer network. 


The remaining routers in the customer network see two candidate gateways of last resort. These 
remaining routers choose the closest one, with respect to the IGP metric. The part of the 
network that is closer to the uppermost exit point uses that exit point for all outgoing traffic. 
The other part of the network uses the other (lower) exit point. 


If both exit points are collocated, they are equally distant from each of the other routers in the 
customer network. Each router within the customer network therefore uses load sharing of 
traffic sent out both exit points. 
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Load Sharing with Static Routes: 
Return Traffic 


Customer Customer Provider Provider 
Router Edge Router Edge Router Router 
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Router Edge Router Edge Router Router 


Customer Network Service Provider Network 


Load sharing of return traffic is impossible to achieve 
with multiple edge routers. 


° All provider routers select the same BGP route to the 
destination. 


* All return traffic arrives at the same provider edge router. 
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The provider routers receive routes toward the customer network via BGP. BGP in its default 
behavior selects a single route as the best route, allowing no load sharing. The provider routers 
that receive the same BGP route from two edge routers will always select the closer edge router 
(if all other BGP attributes are equal, the IBGP route with the closer next hop is selected). The 
part of the ISP network that is closer to the uppermost connection uses that connection. The 
other part of the ISP network uses the other (lower) connection. 


If both connection points are collocated, all provider routers select the same IBGP route based 
on router-ID (because the IGP metrics are always equal) and all the return traffic is sent over a 
single link toward the customer network, resulting in no load sharing. 


Note Since Cisco IOS Release 12.2, the IBGP multipath load-sharing feature enables the BGP- 
speaking router to select multiple IBGP paths as the best paths to a destination. The best 
paths or multipaths are then installed in the IP routing table of the router. 
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Load Sharing with Static Routes: 
Optimizing Return Traffic 


You can optimize return traffic load sharing. 


* Each provider edge router advertises only part of 
customer address space into the provider backbone. 


* Every provider edge router also advertises the whole 
customer address space for backup purposes. 


Load sharing is not optimal—every link will 
carry return traffic for part of customer address 
space. 
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To obtain better control of the return traffic load, the customer address space must be 
advertised to the provider edge routers using multiple, more explicit routes. The upper edge 
router could advertise half the address space, and the lower edge router could advertise the 
other half. For backup reasons, they also should both advertise the entire address space as a 
larger route summary. 


As long as both paths are available, the traffic from the ISP to the customer uses the most 
explicit route. In this case, two explicit routes are used to send traffic representing one half of 
the address space over one link and traffic representing the other half of the address space over 
the other link. 


Load sharing in this way does not result in an equal load on the links but rather a statistically 
based distribution of the traffic load over the links. 
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Example 


Load Sharing with Static Routes: 


Optimizing Return Traffic (Cont) 


ip route 11.2.3.0 255.255.255.128 serial 0 tag 1000 
ip route 11.2.3.0 255.255.255.0 serial 0 tag 1000 
! 


router bgp 387 
redistribute static route-map IntoBGP 


Customer Provider 
Edge Router Edge Router 


Customer Provider 
Edge Router Edge Router 


11.2.3.0/24 AS 387 
Customer Network Service Provider Network 


ip route 11.2.3.128 255.255.255.128 serial 0 tag 1000 
ip route 11.2.3.0 255.255.255.0 serial 0 tag 1000 
' 


router bgp 387 
redistribute static route-map IntoBGP 


BGP v3.1—5-21 


In the example here, the customer address space 11.2.3.0/24 is partitioned into two smaller 
blocks: 11.2.3.0/25 and 11.2.3.128/25. 


The upper provider edge router advertises the route to 11.2.3.0/25, and the lower router 
advertises the route to 11.2.3.128/25. Both edge routers also advertise the entire address space 
11.2.3.0/24. 


The routers in the ISP network direct traffic with destination addresses in the 11.2.3.0/25 range 
to the upper connection point. Traffic to destinations in the 11.2.3.128/25 range is directed to 
the lower connection point. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
Ee 


You can use static routing in most cases when the customer 
network is connected to a single ISP. If there is a single 
connection, you should always use static routing, because 
there is no redundancy. 


If there are multiple links between the customer network and 
a single ISP, you can use static routing provided that the 
static route is invalidated if the link goes down. Detection of 
down links must be done by link-level procedures. 


When you use static routing, the customer should have a 
static default route to the ISP and the ISP should have static 
routes to the entire customer address space. 


The static default route should be redistributed into the 
customer IGP. The static routes to the customer should be 
redistributed into BGP. Redistribution must be conditioned 
by the availability of the connection link if there is 
redundancy. 


2004 Cisco Systems, Inc. All rights reserved 


Summary (Cont.) 


¢ Depending upon the origin of the customer address space, 
the provider may elect not to advertise the customer space, 
choosing to advertise a larger aggregate route instead. 


When you are using static routes in a backup scenario, 
floating static routes are used on the backup routers. After 
the backup floating static route becomes active, its 
administrative distance is ignored by BGP because the 
locally originated route will have a higher weight and be 
preferred, requiring the use of BGP attributes to ensure 
proper floating static operation. 


Load balancing can be achieved for outgoing traffic. Return 
traffic causes problems when multiple connections exist to 
more than one provider router. The best that can be done is 
to split the address space for the balancing of return traffic. 
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References 


For additional information, refer to these resources: 


= For more information on multihoming, refer to “Sample Configuration for BGP with Two 
Different Service Providers (Multihoming)” at the following URL: 
http://www.cisco.com/warp/public/459/27.html 


m= For more information on static routing, refer to “Routing TCP/IP Volume 1,” Jeff Doyle, 
Cisco Press, 1998. ISBN 1-57870-041-8 
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Connecting a Multihomed 
Customer to a Single Service 
Provider 


Overview 


Customers connect to the Internet using service providers to enable different applications such 
as intranet connectivity with VPNs, extranet connectivity with suppliers, and other Internet 
applications. Different customers have different connectivity requirements depending upon 
their business model, redundancy requirements, and even network budget. 


This lesson discusses the use of multiple connections between a customer and a single service 
provider for backup and load-sharing purposes. Included in this lesson is a discussion of how to 
configure a customer network and a provider network to accommodate multiple connections 
between them. Also discussed in this lesson are topics specific to networks with multiple 
connections between a customer and a single provider, such as private AS number removal and 
configuration of a network to support either backup links or load sharing (balancing). 


Relevance 


When multiple connections to the same service provider are the only means that a customer has 
of connecting to the Internet, it is important that the connections be correctly configured to 
ensure proper interaction between the customer and service provider network. It is also 
important to understand how to configure routing protocols so that customer backup or load- 
balancing requirements are met. 
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Objectives 


Upon completing this lesson, you will be able to explain the connectivity between a 
multihomed customer and a single service provider. This includes being able to meet these 
objectives: 


= Configure BGP on a customer network to establish routing between a multihomed 
customer and a single service provider 


m= Configure conditional advertising of a customer address space when you are using BGP to 
establish routing between a multihomed customer and a single service provider 


= Configure BGP on a service provider network to establish routing between a multihomed 
customer and a single service provider 


m Disable the propagation of private AS numbers to EBGP peers in a service provider 
network where a multihomed customer is advertising private numbers in the AS path 


= Configure a typical backup setup between a multihomed customer and a single service 
provider in a BGP environment 


m Describe how you can implement load sharing between a multihomed customer and a 
single service provider in a BGP environment 


m Identify the Cisco IOS command that is required to configure load sharing between a 
multihomed customer and a single service provider using BGP multipath 


™ Configure load sharing between a multihomed customer and a single service provider using 
EBGP multihop 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m™ Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 
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Outline 


The outline lists the topics included in this lesson. 


Outline 
_ EE = = =—ssSsSsSsC~isco.com 


° Overview 


* Configuring BGP on Multihomed Customer 
Routers 


* Conditional Advertising in Multihomed Customer 
Networks 


* Configuring BGP on Service Provider Routers 
* Removing Private AS Numbers 

* Backup Solutions with BGP 

* Load Sharing with the Multihomed Customer 
* Load Sharing with BGP Multipath 

* Load Sharing with EBGP Multihop 

° Summary 
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Configuring BGP on Multihomed Customer 
Routers 


This topic describes how to configure BGP on a customer network to establish routing between 
a multihomed customer and a single service provider. 


Configuring BGP on Multihomed Customer 
Routers 


Customer advertises allocated BGP is run between the customer 
address space into BGP and the service provider 


Customer Customer 
Router Edge Router Edge Router 

Service provider 

has to deploy 

inbound BGP filters 


“> J 


| 


Customer Provider 
Edge Router Edge Router 


AS 65001 AS 387 
Customer Network Service Provider Network 


Provider announces only the 
default route to the customer 
Customer uses a private AS number 
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In the example here, the customer network is connected to a service provider network using 
multiple permanent links. BGP is used to exchange routing information between the customer 
and the provider. 


Selecting BGP as the routing protocol between the customer and provider network ensures that 
a link failure or the failure of a remote router is detected. In this scenario, the customer does not 
require the use of a public AS number or full Internet routing. Instead, a private AS number is 
assigned to the customer network, and the ISP sends a default route to the customer through 
BGP. 


The big difference in this case, as compared to a network scenario where static routes and 
redistribution are used, is that routers within the private AS of the customer now advertise the 
customer routes via BGP. Thus, the customer is responsible for announcing its own address 
space. The ISP receives routes from the customer and conditionally propagates them (similar to 
static routing). If the customer uses PA address space, and the ISP can summarize the address 
space, it will not propagate the explicit routes from the customer to the Internet. The private AS 
number in the AS-path attribute must first be removed before the ISP can propagate any of the 
customer routes. 
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Because the customer is now creating BGP routes that are received by the ISP, any error made 
by the customer can influence routing operation within the ISP network and, if propagated, 
within the Internet as a whole. Announcing a route to a network to which the customer has not 
been assigned may cause routing problems. There is always a risk that such routing problems 
can occur in a service provider network. However, the risk is much greater when the customer, 
whose network administrators usually have less experience with BGP, enters the configuration. 


To reduce the risk of erroneous route advertising, the ISP should always filter any BGP 
information that it has received from the customer network. The ISP should reject routes to 
networks that are not expected to be in the customer AS. Routes that contain an AS path with 
unexpected AS numbers should also be rejected. 


Example 


Configuring BGP on Multihomed Customer 
Routers (Cont.) 


ip route 11.2.3.0 255.255.255.0 null 0 
router bgp 65001 

neighbor 11.2.3.1 remote-as 65001 
neighbor 10.0.0.2 remote-as 387 
network 11.2.3.0 mask 255.255.255.0 
router ospf 1 


IGP session default-information originate 
eA { ver oF -S 


11.2.3.0/24 
AS 65001 AS 387 
Customer Network Service Provider Network 


0026_319 


¢ Customer address space is advertised on every customer edge router. 


¢ Customer edge routers run IBGP between themselves and advertise 
default route to the rest of the customer network. 
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In this figure, the customer has been assigned the private AS number 65001. Both customer 
edge routers are configured to run BGP and should advertise all of the customer networks with 
the network command. If only one router advertises the network, a single point of failure has 
been introduced. The two customer edge routers must also run IBGP between them to make 
common decisions regarding BGP routing information. 


Each customer edge router has an EBGP session with the ISP router on the other side of the 
link. Over that EBGP session, the ISP announces only a default route to the customer AS. 
When EBGP receives the default route, it installs it in the routing table and redistributes it into 
the IGP (in this case, OSPF) of the customer. 
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Conditional Advertising in Multihomed Customer 
Networks 


This topic describes how to configure conditional advertising of a customer address space when 
you are using BGP. 


Conditional Advertising in Multihomed 
Customer Networks 


¢ Customer edge routers should announce the 
whole customer address space into BGP. 


° The static route covering the whole customer 
address should point to the core of the 
customer network, not to null 0. 


¢ Customer edge router revokes the BGP 
announcement of customer address space if 
the edge router loses connectivity with the 
customer core. 
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As arule of thumb, the customer should announce addresses as large as possible (the larger the 
address space that can be aggregated, the better). The BGP advertisement is configured on the 
customer edge routers using the network command. Route advertisement is conditioned by the 
appearance of a corresponding network or subnet in the routing table of the edge router. If the 
network or subnet is manually entered into the routing table by configuring a static route to 
“null 0,” the condition is always true because the static route is always there, and the BGP 
advertisement is always performed. 


If the customer edge router loses connectivity to the rest of the customer network but is still 
connected to the ISP network, BGP advertisement must cease. In this case, BGP advertisement 
can be stopped if BGP advertisements are bound to the reachability status of a specific subnet 
in the core of the customer network, according to the customer IGP. 


The problem with using a static route to null 0 is that it conditions the network statement in the 
BGP configuration so that BGP always advertises the route. If the customer edge router loses 
connectivity with the rest of the customer network, the router continues to advertise the entire 
customer address space. The ISP network receives a valid route from the customer edge router. 
Traffic is sent to this router, but because it has lost connectivity with the rest of the network, the 
traffic is dropped (routed to the null 0 interface using the static route). 
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Example 


Conditional Advertising in Multihomed 
Customer Networks (Cont.) 


13.5.1.0/24 
Customer Core 


13.5.0.0/16 
AS 65001 
Customer Network 


ip route 13.5.0.0 255.255.0.0 13.5.1.1 
router bgp 65001 

neighbor 11.2.3.1 remote-as 65001 
neighbor 10.0.0.2 remote-as 387 
network 13.5.0.0 mask 255.255.0.0 
router ospf 1 

default-information originate 


In this example, the customer network uses the address space 13.5.0.0/16. The address space is 
further subnetted at the customer site. One of the subnets (subnet 13.5.1.0/24) is identified as 
being a central part of the customer core network. 


The customer edge routers participate in the IGP routing of the customer. This participation 
means that these routers have information about which of the subnets within the address space 
13.5.0.0/16 are currently reachable. If these subnets are available, there is an explicit route to 
each of them. If any of the subnets go down, or the path toward them goes down, the route to 
that subnet is removed from the routing table. 


The BGP advertisement in each of the customer edge routers is configured to advertise the full 
address space that is used by the customer. When this route is advertised by the customer edge 
routers, the ISP network, and thus the rest of the Internet, see the complete address space of the 
customer as one single route, 13.5.0.0/16. 


Advertisement of the customer address space by BGP is conditioned by the appearance of the 
static route, ip route 13.5.0.0 255.255.0.0 13.5.1.1. If the static route is valid, then the BGP 
route 13.5.0.0/16 is advertised. The static route is a recursive route, which means that the router 
takes another look in the routing table for the address 13.5.1.1 before determining what to do 
with the static route. The idea is that 13.5.1.1 is reachable via the IGP. The subnet 13.5.1.0/24 
is announced by the IGP. If this subnet is reachable by the edge router, then the static route to 
13.5.0.0/16 is valid. If there is no route to 13.5.1.1, then the static route is invalid. 


Note The condition, whether or not to advertise the entire customer address space 13.5.0.0/16, is 
controlled by the IGP reachability of a single subnet, 13.5.1.0/24. 


The IGP configuration also includes origination of the default route by both edge routers. 
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Configuring BGP on Service Provider Routers 


This topic describes how to configure BGP on a service provider network to establish routing 
between a multihomed customer and a single service provider. 


Configuring BGP on 
Service Provider Routers 


11.2.3.0/24 
AS 65001 AS 387 
Customer Network Service Provider Network 


The service provider must 
° Advertise a default route to the customer through BGP. 


¢ Filter incoming BGP updates with a prefix-list to verify that the 
customer announces only the assigned address space. 


¢ Filter incoming BGP updates with an AS-path filter-list to verify that 
the customer uses only its own AS number. 


° Optionally, no-export community should be set on customer routes. 
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In the ISP network, the two edge routers must have BGP sessions configured for the customer. 
There is no point in feeding the full Internet routing table to the customer, because the table 
contains the same set of routes for both links and the customer always uses the ISP for all 
traffic toward the Internet. Injection of a default route in the customer network would 
accomplish the same task. 


The customer is responsible for its own advertisements. Assuming that customers are much less 
experienced in BGP configuration than the ISP, they are more likely to make errors. Therefore, 
the ISP must protect itself and the rest of the Internet from those errors. 


The service provider should use a prefix-list that allows only customer-assigned routes and 
denies any other route to ensure that private address space or any other illegal networks that are 
erroneously announced by the customer never reach the ISP BGP table. Filtering based on the 
AS path also provides some protection from customer configuration errors. Only routes that 
originated within the customer AS are allowed. A filter-list performs this check. 


If the customer address space is PA address space, and it represents only a small part of a larger 
block that is announced by the ISP, the explicit BGP routes that are received from the customer 
need not be advertised to the rest of the Internet. The ISP can announce the big block, attracting 
any traffic toward any subnet within the block. After the traffic enters the ISP network, the 
more explicit routes to the customer network are available and used. In this case, the provider 
edge router can tag the BGP routes that are received from the customer with the no-export well- 
known community, restricting them from being sent by the ISP to any other AS. 
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Configuring BGP on 


Service Provider Routers (Cont) 


router (config-router) # 


neighbor ip-address default-originate 


° By default, the default route (0.0.0.0/0) is not 
advertised in outgoing BGP updates. 


° The neighbor default-originate command advertises 
default route to a BGP neighbor even if the default 
route is not present in the BGP table. 


* Note: The default route is not sent through the 
outbound BGP filters (prefix-list, filter-list, or route- 
map). 


The default route, 0.0.0.0/0, is not advertised in outgoing BGP updates unless it is explicitly 
configured. The neighbor default-originate router configuration command is used to initiate 
the advertisement of the default route to a neighbor. 


No checking is done by BGP before the default route is advertised. The default route does not 
need to be present in the BGP table before it is advertised using this command. The default 
route is also sent without being filtered by any outgoing prefix-lists, filter-lists, or route-maps. 
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Example 


Configuring BGP on 


Service Provider Routers ceont) 


11.2.3.0/24 11.2.0.0/16 
AS 65001 AS 387 
Customer Network Service Provider Network 


router bgp 387 

neighbor 10.0.0.1 remote-as 65001 

neighbor 10.0.0.1 default-originate 

neighbor 10.0.0.1 prefix-list DefaultOnly out 
neighbor 10.0.0.1 prefix-list CustomerA in 
neighbor 10.0.0.1 filter-list 15 in 

neighbor 10.0.0.1 route-map AllCustomersIn in 


ip as-path access-list 15 permit *65001( 65001) *$ 
ip prefix-list DefaultOnly permit 0.0.0.0/0 

ip prefix-list CustomerA permit 11.2.3.0/24 le 32 
ip prefix-list Provider permit 11.2.0.0/16 le 32 


route-map AllCustomersIn permit 10 
match ip prefix-list Provider 
set community no-export additive 


route-map AllCustomersIn permit 9999 
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This example shows the configuration of an ISP edge router. 


The customer is assigned the private AS number 65001. The BGP session is opened with the 
customer IP address, 10.0.0.1. 


The ISP sends the default route only to the customer. This route is configured first using first 
the default-originate command and then the prefix-list “DefaultOnly.” 


Received routes from the customer must first pass the prefix-list “CustomerA.” There is one 
dedicated prefix-list for each individual customer; the prefix-list permits only those routes that 
the customer is allowed to announce. If the routes are allowed by the prefix-list, they must also 
pass the filter-list “15 in.” In this case, the filter allows the private AS of the customer in any 
number of repetitions, as long as it is the only AS number in the path. This filter-list allows for 
AS-path prepending configurations on the customer side. If the received route is allowed by 
both the prefix-list and the filter-list, then the route-map “AllCustomersIn” is applied. 


The route-map is a general route-map that is used for all customers. It checks every route that is 
received, via the prefix-list “Provider,” and if the route is within the big block of PA address 
space that the ISP announces to the rest of the Internet, the customer route is marked with the 
no-export community. This mark means that the route is used within the ISP AS only, and is 
not sent to the rest of the Internet. 


Routes that are received from the customer, and are allowed by the prefix-list and filter-list, but 
do not fall within the PA address space, are allowed by the route-map and are not changed in 
any way. The ISP propagates these routes to the rest of the Internet. 
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Removing Private AS Numbers 


This topic describes how to disable the propagation of private AS numbers to EBGP peers ina 
service provider network where a multihomed customer is advertising private numbers in the 
AS path. 


Private AS Number Propagation 


13.5.0.0/16 
AS 65001 


13.5.0.0/16 13.5.0.0/16 13.5.0.0/16 
AS=65001 AS=65001 AS=387 65001 
¢ Private AS numbers should not be advertised into the Internet. 


* The private AS numbers must be removed from the AS path 
before the customer BGP routes are advertised to other service 
providers. 


002G_323 


Routes that are received by the ISP from the customer are propagated to the rest of the Internet 
only if they are part of the provider-independent (PI) address space. 


When the ISP receives BGP routes from the customer, the AS-path attribute of the received 
routes contains only the AS number of the customer. If the customer uses AS-path prepending, 
there may be several repetitions of the customer AS number in the AS path. If customer routes 
are propagated by the service provider to the Internet, the AS number of the customer will be 
present in the AS path unless it is explicitly removed. 


Note If the customer has been assigned a private AS number, this AS number must never be 
advertised by any router to the rest of the Internet. 


Removal of a private AS number from the AS path is accomplished by using remove-private- 
as on the ISP EBGP sessions with the rest of the Internet. In the figure, removal of the private 
AS number takes place on the EBGP session between AS 387 and AS 217. 
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Removing Private AS Numbers 
—————————————— ns Sintered, 


router (config-router) # 


neighbor ip-address remove-private-as 


* The command modifies AS-path processing on 
outgoing updates sent to specified neighbor. 


¢ Private AS numbers are removed from the tail of the 
AS path before the update is sent. 


¢ Private AS numbers followed by a public AS number 
are not removed. 


¢ AS number of the sender is prepended to the AS path 
after this operation. 


neighbor remove-private-as 


To remove private AS numbers from the AS path (a list of AS numbers that a route passes 
through to reach a BGP peer) in outbound routing updates, use the neighbor remove-private- 
as router configuration command. 


m neighbor {ip-address | peer-group-name} remove-private-as 


To disable this function, use the no form of this command. 


= no neighbor {ip-address | peer-group-name} remove-private-as 


Syntax Description 


Parameter Description 
ip-address IP address of the BGP-speaking neighbor 
peer-group-name Name of a BGP peer group 


Use this command on the service provider egress routers. Before any of the customer routes of 
the ISP are advertised by the service provider to the rest of the Internet, the AS numbers in the 
range 64512-65535 must be removed. The command removes those AS numbers if they are in 
the tail end of the AS path. Caution, private AS numbers followed by public AS numbers are 
not removed since the command’s visibility is only on the last (tail end) AS number. 


The AS number of the ISP is automatically prepended to the AS-path attribute after the 
remove-private-as operation has completed. This situation means that the AS number of the 
ISP has not already been prepended to the AS-path attribute when the tail of the AS path is 
checked for private AS numbers. 
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Example 


Removing Private AS Numbers (Cont. 


router bgp 387 
neighbor 10.2.3.3 remote-as 217 
neighbor 10.2.3.3 remove-private-AS 


13.5.0.0/16 
AS 65001 


13.5.0.0/16 13.5.0.0/16 13.5.0.0/16 
AS=65001 AS=65001 AS=387 


Private AS number is removed before the update is sent into AS 217 


0026 _324 
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In this example, the service provider AS (387) receives routes from the customer. The customer 
is assigned the private AS number 65001 by the ISP. Therefore, routes that are received by the 
provider have an AS path containing only AS 65001. This information should be kept and used 
within the ISP network and should never be propagated to the rest of the Internet (AS 217 in 
this example). 


The edge router in AS 387 has been configured to remove private AS numbers on EBGP routes 
toward AS 217. If private AS numbers appear in the tail end of the AS path (before AS 387 is 
added), they are removed. 


This configuration must be applied to all egress routers in AS 387 that serve EBGP neighbors 
leading to other ISPs. No private AS number may be present in an AS path of a route that is 
propagated to a network using a public AS number. 
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Backup Solutions with BGP 


This topic describes how to configure a typical backup setup between a multihomed customer 
and a service provider in a BGP environment. 


Backup Solutions with BGP 


The route selection is controlled entirely by the 
customer routers. 


¢ Local preference is used to differentiate primary 
and backup links for the outgoing traffic. 


* The MED is used to differentiate primary and 
backup links for the return traffic. 


* No service provider configuration is required. 
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When a customer uses BGP on multiple links between its network and the ISP network, the 
customer is solely responsible for controlling how it uses the links. The customer can choose to 
use its links in a primary/backup scenario or in a load-sharing scenario. 


If one link is primary, then the other should be used for backup only. The customer can use the 
local preference configuration to direct all outgoing traffic over the primary link. 


Incoming traffic to the customer is controlled by using either AS-path prepending or the multi- 
exit discriminator (MED). Because the customer has multiple connections to the same AS, the 
MED is the ideal attribute to use. When the customer announces its routes to the ISP, a bad 
(high) MED value on the backup link and a good (low) value on the primary link are set. 


The MED (and AS-path length) is checked by the receiving EBGP peer only if the weight and 
local preference attributes have not been configured. In this case, the ISP should not use any of 
these configuration options. The ISP should rely solely on the attributes that it has received 
from the customer. 
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Example 


Primary/Backup Link Selection 


router bgp 65001 

bgp default local-preference 100 
neighbor 10.0.0.6 remote-as 387 
neighbor 10.0.0.6 route-map LowMED out 


route-map LowMED permit 10 
set metric 1000 


11.2.3.0/24 
AS 65001 AS 387 
Customer Network Service Provider Network 


router bgp 65001 

bgp default local-preference 50 
neighbor 10.0.0.2 remote-as 387 
neighbor 10.0.0.2 route-map HiMED out 


route-map HiMED permit 10 
set metric 2000 
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In the figure, the customer is connected to the ISP over two permanent connections. The 
customer uses the upper connection as the primary connection and the lower connection as the 
backup. 


The BGP configuration on the ISP side is transparent. This transparency means that no 
particular preference is configured to use the upper or lower connection. The ISP relies on the 
attribute values that are received from the customer. 


The primary edge router on the customer side is configured to set local preference to the value 
100 on all EBGP routes that are received. The backup edge router sets the local preference 
attribute to a value of 50. This configuration means that the outgoing traffic toward any 
destination that is announced by the ISP is primarily sent over the upper link. 


Incoming traffic to the customer is directed to the primary link by using the MED. In the 
primary edge router of the customer, all routes that are sent to the ISP have their MED attribute 
set to the value 1000 by the route-map “LowMED out.” In the backup edge router of the 
customer, all routes that are sent to the ISP have their MED attribute set to the value 2000 by 
the route-map “HiMED out.” Because the ISP receives the routes with all other attributes set to 
the same values, the MED values direct traffic for the customer to the primary link. 
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Load Sharing with the Multihomed Customer 


5-62 


This topic describes how you can implement load sharing between a multihomed customer and 
a service provider in a BGP environment. 


Load Sharing with the 
Multihomed Customer 


Load sharing of outgoing customer traffic is 
identical to the static routing scenario. 


You can implement load sharing of return 
traffic in a number of ways: 


¢ Announce portions of the customer address space 
to each upstream router 


¢ Configure BGP multipath support in the service 
provider network 


¢ Use EBGP multihop in environments where parallel 
links run between a pair of routers 
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Load sharing of outgoing traffic from the customer network is identical to the static routing 
scenario. The customer IGP is configured to send information about a gateway of last resort. 
There is no difference whether the edge router gets its default by static routing or by incoming 
EBGP updates. 


Load sharing of the return traffic coming back to the customer network from the ISP can be 
implemented in a number of ways: 


m The customer can divide its address space into several announcements. The customer edge 
router can send each announcement over one of its EBGP sessions with the ISP. For 
backup purposes, the customer should advertise the entire address space over all of its 
EBGP sessions. The ISP now uses the most explicit route rule, and as long as both links are 
up, traffic with destinations within one part of the customer address space is routed over 
one of the links and traffic to the other part is routed over the other link. 


m If the customer announces equivalent routes over both links, the ISP routers use the closest 
connection with respect to the IGP of the ISP. If an ISP router has an equivalent distance to 
both connection points, the use of the maximum-paths (BGP multipath) option causes load 
sharing. 


m= If the multiple links between the customer and the ISP network terminate in one single 
router on the customer side and one single router on the ISP side, the two routers must 
establish their EBGP session from loopback interface to loopback interface. Static or 
dynamic routing is required for one router to get information on how to reach the loopback 
interface of the other router. The use of the ebgp-multihop option is also required because 
the address of the neighbor is not directly connected. 
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Load Sharing with BGP Multipath 


This topic presents the Cisco IOS command that is required to configure load sharing between a 
multihomed customer and a service provider through the use of BGP multipath. 


Configuring BGP Multipath Support 
ee 


router (config-router) # 


maximum-paths number 


* By default, BGP selects a single path as the best path 
and installs it in the IP routing table. 


¢ With maximum-paths configured, a BGP router can 
select several identical EBGP routes as the best 
routes and install them in the IP routing table for 
load-sharing purposes. 


¢ The BGP router can install up to six BGP routes in the 
IP routing table. 
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By default, BGP route selection rules select one, and only one, route as the best. If there are 
two identical routes, the tiebreaker is the most stable route or the router-ID of the peer router 
that is advertising the route. However, by using the maximum-paths router configuration 
command, the BGP route selection process will select more than one route as best if they are 
exactly identical. The routes are all installed in the routing table, and load sharing takes place. 
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maximum-paths 
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To control the maximum number of parallel routes that an IP routing protocol can support, use 
the maximum-paths command in address family or router configuration mode. 


= maximum-paths number 


To restore the default value, use the no form of this command. 


™ no maximum-paths 


Syntax Description 


Parameter Description 


number Maximum number of parallel routes that an IP routing protocol 
installs in a routing table, in the range of 1 to 6 
Note Load sharing between alternative BGP routes is achieved only if the EBGP routes are 


identical according to all BGP route selection rules and maximum-paths is configured with 
a value larger than 1. 


A BGP router can install up to six BGP routes in the IP routing table. The actual type (per- 
session or per-packet) of load sharing that occurs between the routes depends on the switching 
mode that is used. 
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Load Sharing with EBGP Multihop 


This topic describes how to configure load sharing between a multihomed customer and a 
service provider through the use of EBGP multihop. 


Load Sharing with EBGP Multihop 


Customer Edge Provider Edge 


AS 65001 AS 387 
Customer Network Service Provider Network 


EBGP session is run 
between loopback 
interfaces of adjacent routers 


* Because of recursive lookup, load sharing toward a BGP 
destination always occurs if there are several equal-cost IGP 
paths to the BGP next hop. 


* Equal-cost IGP paths are easily generated if the BGP next 
hop is not directly connected. 
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When two adjacent routers have multiple links between them, you can configure the EBGP 
session from loopback interface to loopback interface. In this case, you must use the ebgp- 
multihop option to make the BGP session go into the active state. There must be static or 
dynamic routing in use to provide both routers with information on how to reach the loopback 
interfaces of each other. Otherwise, their EBGP session does not complete establishment. 


Routing to the loopback interface of the neighboring router is required to establish the EBGP 
session and is also used in the recursive lookup when the routes are installed by the router in its 
routing table. The two routes to the loopback interface of the neighboring router should be 
equivalent for load sharing to occur. 


After configuration, one single EBGP session is established between the two routers. This 
session is used to exchange the routing information. There is only one BGP route to each 
destination, and it has a next hop that refers to the loopback interface of the other router. 


Before installing a route to a specific destination in its routing table, a router will perform a 
recursive lookup to resolve the next hop. In this case, the recursive lookup will result in finding 
two alternative routes. The router will install the BGP route to the final destination twice in the 
routing table (Forwarding Information Base [FIB]). The first time, the route is installed with 
one of the resolved next-hop addresses, and the second time with the other resolved next-hop 
address. Because multiple equal-cost paths exist, the router can load-share over the two paths, 
depending on the switching mode. 
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Configuring Multihop EBGP Sessions 


router (config-router) # 
neighbor ip-address ebgp-multihop [ TTL ] 
* By default, EBGP neighbors must be directly connected. 


* The ebgp-multinop command declares an EBGP neighbor 
to be distant (several hops away). 


Number of hops can be specified in the 77L parameter. 


Usually used to run EBGP between loopback interfaces 
for dial backup or load-sharing purposes. 


Use with extreme caution; routing loops can occur very 
easily. 
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By default, EBGP neighbors must be directly connected. Cisco IOS software verifies that an 
EBGP neighbor is reachable as directly connected over one of the router interfaces before the 
session goes into the active state. For an EBGP session, IP packets that carry the TCP segments 
with BGP information are also sent using a Time to Live (TTL) value set to the value 1. This 
value means that they cannot be routed. 


The ebgp-multihop neighbor configuration command changes this behavior. Although the 
neighbor is several hops away, the session goes into the active state, and packets start to be 
exchanged. The TTL value of the IP packets is set to a value larger than 1. If no value is 
specified on the command line, 255 is used. 


Use the ebgp-multihop command when you are establishing EBGP sessions between loopback 
interfaces for load-sharing purposes. You must take great care when using ebgp-multihop, 
because proper packet forwarding relies on all the intermediate routers along the path to the 
EBGP peer to make the correct forwarding decision. If the intermediate routers have a correct 
path to the EBGP peer, but a wrong path to the final destination, the packet may get into a 
routing loop. 
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Example 


Load Sharing with EBGP Multihop (Cont.) 


Customer Edge Provider Edge 


AS65001 AS 387 
Customer Network Service Provider Network 


interface loopback 0 interface loopback 0 
ip address 3.0.0.1 255.255.255.255 ip address 1.0.0.1 255.255.255.255 
interface serial 0 interface serial 3/2 
ip address 2.0.0.2 255.255.255.252 ip address 2.0.0.1 255.255.255.252 
interface serial 1 interface serial 3/5 
ip address 2.0.0.6 255.255.255.252 ip address 2.0.0.5 255.255.255.252 


router bgp 65001 router bgp 387 

neighbor 1.0.0.1 remote-as 387 neighbor 3.0.0.1 remote-as 65001 
neighbor 1.0.0.1 update-source loop 0 neighbor 3.0.0.1 update-source loop 0 
neighbor 1.0.0.1 ebgp-multihop 2 neighbor 3.0.0.1 ebgp-multihop 2 


ip route 1.0.0.1 255.255.255.255 2.0.0. ip route 3.0.0.1 255.255.255.255 


2.0.0. 
ip route 1.0.0.1 255.255.255.255 2.0.0. ip route 3.0.0.1 255.255.255.255 2.0.0.6 
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In the figure, the customer network and the ISP network are connected using two parallel links 
between a single router on the customer side and a single router on the ISP side. 


In this case, only one EBGP session is configured between the customer and provider routers. 
The session should be established from the loopback interface in one router to the loopback 
interface in the other. 


Each of the two edge routers has two static host routes that point to the loopback interface on 
the other router. The EBGP session is established from loopback to loopback using ebgp- 
multihop. 


The customer receives an EBGP route from the ISP with the next hop set to 1.0.0.1. The 
customer edge router performs a recursive lookup and finds that it can reach 1.0.0.1 via 2.0.0.1 
and via 2.0.0.5. These two routes are equivalent. Therefore, the route to the final destination is 
installed in the routing table of the customer router using both paths. 


Depending on the switching mode in use, load sharing is done per packet, per destination, or 
per source and destination pair. 


In this example, link-level procedures ensure that if one of the links goes down, the 
corresponding static link goes down. All BGP routes in the routing table that rely on the static 
route to the link that went down are invalidated. However, the BGP routes in the routing table 
that rely on the remaining link are still valid and used. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
a 


* When a customer has multiple connections to a single ISP 
and the link-level procedures cannot detect a link failure, a 
routing protocol is required. For security reasons, this 
routing protocol must be BGP. 


* The AS number that is used by the customer does not 
have to be a public AS number; it can be a private AS 
number in the range 64512 — 65535. 


¢ When conditionally advertising customer networks to the 
service provider, you should use a static route covering 
the whole customer address space and pointing to the 
core of the customer network instead of null 0. 


* The service provider should advertise a default route to 
the customer through BGP. Incoming filters should also be 
used by the provider to ensure that only the correct 
address space and AS number are advertised by the 
customer. 


Summary (Cont.) 


* Private AS numbers must never be propagated to the rest 
of the Internet. The ISP must therefore remove the private 
AS numbers from the AS path before sending them to 
another public AS. 


You can use parallel links between the customer network 
and the network of a single ISP for backup or load- 
sharing purposes. The customer controls the outgoing 
load using local preference. The customer can control the 
incoming load using the MED (metric) attribute. With the 
MED, the links go to a single remote AS. 


By announcing portions of its address space, a customer 
can use maximum paths and EBGP multihop to provide 
load sharing over multiple links. 


EBGP multihop can be used for load balancing only if 
redundant links terminate on the same provider router. 
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References 


For additional information, refer to these resources: 


= For more information on removing private AS numbers, refer to “Removing Private 
Autonomous System Numbers in BGP” at the following URL: 
http://www.cisco.com/warp/public/459/32.html 


m= For more information on using the MED for path selection, refer to “How BGP Routers 
Use the Multi-Exit Discriminator for Best Path Selection” at the following URL: 
http://www.cisco.com/warp/public/459/37.html 


m= For more information on load sharing, refer to “Sample Configurations for Load Sharing 
with BGP in Single and Multihomed Environments” at the following URL: 
http://www.cisco.com/warp/public/459/40.html 
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Connecting a Multihomed 
Customer to Multiple Service 
Providers 


Overview 


Customers connect to the Internet using service providers to enable different applications such 
as intranet connectivity with VPNs, extranet connectivity with suppliers, and other Internet 
applications. Different customers have different connectivity requirements depending upon 
their business model, redundancy requirements, and even network budget. 


This lesson discusses using multiple connections between a customer and multiple service 
providers for backup and load-sharing purposes. Included in this lesson is a discussion of the 
BGP characteristics that are used to configure customer and provider networks to accommodate 
the multiple connections between them. Also discussed in this lesson are topics specific to 
networks with multiple connections between a customer and multiple providers such as address 
selection, private AS number translation, and configuration of the network to support either 
backup links or load sharing. 


Relevance 


When a customer requires the maximum redundancy in its network design, it should implement 
a multihomed strategy that uses multiple service providers. This configuration requires specific 
considerations to be implemented properly. Addressing and AS number selection are important 
considerations that affect the implementation of the network. It is also important to understand 
how to configure routing protocols so that customer backup or load-sharing requirements are 
met. 
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Objectives 


Upon completing this lesson, you will be able to explain the connectivity between a 
multihomed customer and multiple service providers. This includes being able to meet these 
objectives: 


m Describe BGP configuration characteristics that are used to establish routing between a 
multihomed customer and multiple service providers 


m Describe addressing strategies that are available to a multihomed customer that is 
connected to multiple service providers 


m Describe AS numbering strategies that are available to a multihomed customer that is 
connected to multiple service providers 


m™ Describe the operation of AS number translation 


m Describe how you can implement a typical backup setup between a multihomed customer 
and multiple service providers in a BGP environment 


= Describe the use of BGP attributes to influence inbound link selection in customer 
networks that are multihomed to multiple service providers 


m™ Describe how you can implement load sharing between a multihomed customer and 
multiple service providers in a BGP environment 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
———— ee  Cisco’com mann 


° Overview 
¢ Configuring BGP for Multihomed Customers 


¢ Multihomed Customer Address Space 
Selection 


¢ Multihomed Customer AS Number Selection 
¢ AS Number Translation 

¢ Primary/Backup Link Selection 

° BGP Incoming Link Selection 


¢ Load Sharing with Multiple Providers 
° Summary 
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Configuring BGP for Multihomed Customers 


This topic describes the different characteristics of a BGP configuration that is used to establish 
routing between a multihomed customer and multiple service providers. 


Configuring BGP for 
Multihomed Customers 


Customer advertises allocated BGP is run between the Customer 
address space into BGP and the Service Provider 


Customer Customer Provider : 
Router Edge Routers Edge Router peice: A 


Service Providers 
have to deploy 
inbound BGP filters 


a  F* 


168.22.4.0/18 Cea 


AS 123 Edge Router Service 


Customer Network Provider B 


002G_328 


Providers announce default route, 
local networks, or full Internet 
routing to the customer 


BGP v3.1—5-3 


The highest level of resilience to network failures is achieved in network designs that connect 
the customer network to two different service provider networks. Customers use this option 
when the requirement for resilient Internet connectivity is very high. This requirement also 
involves duplication of equipment to make the customer network fully redundant. 


BGP must be used between the customer and both service providers, because static routing will 
not work in this type of network. It is not enough to detect link failures or a failure in the 
remote router by link-level procedures. Failures that occur beyond the directly connected router 
must also be detected, and the only means of detecting these failures is by using a routing 
protocol. The only routing protocol that is suited for the Internet environment is BGP. Correctly 
configured, BGP takes care of rerouting in the following situations: 


@ = Link failure between the customer network and the network of one of the ISPs. 
m Edge router failure on either the customer or the ISP side. 


m Link failure or router failure within the customer network that causes the customer edge 
router to lose connectivity with the customer network core. This situation requires correct 
configuration of route advertisement as described in an earlier lesson. 


m = Link failure or router failure within the ISP network that causes the ISP edge router to lose 
connectivity with the rest of the Internet. 


Multihomed customers have multiple permanent links to different ISPs. The links should 
terminate in different edge routers in the customer network. Otherwise, one of the major 
advantages, resilience to router failure, is lost. 
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Multihomed customers should use BGP with both ISPs. The customer should advertise its 
address space to both providers. Route advertisement should be configured in both customer 
edge routers. The advertisement should be conditioned at the edge routers by the appropriate 
route policies leading toward the core of the customer network. This setup is analogous to what 
is configured when you are connecting a multihomed customer network to a single provider. 


The customer should take care not to move any routing information between the two ISPs. It 
must use outgoing filters to prevent any route that is received from one of the ISPs to be 
propagated to the other. Otherwise, the customer network appears as a transit network between 
the two ISPs. 


Both ISPs must apply filters on the incoming BGP information from the customer to protect 
themselves and the rest of the Internet from errors in the BGP configuration of the customer. 
Each of the service providers must accept routes from the customer that indicate networks 
within the customer address space only. AS-path filter-lists should be implemented on the 
provider edge routers to allow incoming routes only if they have the correct AS-path attribute 
value. If the incoming filters on the ISP edge router accept customer routes, then the service 
provider should propagate those routes to the rest of the Internet. 


Both ISPs must provide the customer with at least some BGP routes. Depending on customer 
requirements, the volume of BGP routes that are provided by the ISP could range anywhere 
from the default route only, to the full Internet routing table. 
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Before configuring the multihomed network, you need to consider the following questions: 
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Configuring BGP for 
Multihomed Customers (Cont.) 


Customer Customer Provider 
Router Edge Routers Edge Router 


1 68.22.4.0/1 8 Provider 
AS 123 Edge Router 


Service 
Provider A 


Service 
Provider B 


Link usage — primary/backup or load sharing 


Address space — belonging to the customer or ISP assigned 
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Should any of the links be used as primary and the others as backup? 


Should both links share the load? 


What address space is the customer using? (Is the customer address space PA or PI?) 


What AS number is the customer using? (Is the customer using a public or a private 


AS number?) 


Customer-to-Provider Connectivity with BGP 
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Multihomed Customer Address Space Selection 


This topic describes the different addressing strategies that are available to a multihomed 
customer that is connected to multiple service providers. 


Multihomed Customer 
Address Space Selection 


° Provider-Independent Address Space 


—If the customer owns the address space, there 
should be no limitations regarding announcing it to 
both service providers. 


° Provider-Assigned Address Space 


—If the customer uses ISP-assigned small address 
blocks, then there is no purpose in using BGP to 
provide redundant connectivity. NAT is easier to 
implement and solves the problem of reverse path. 


If the customer has its own address space, it should announce it to both service providers. Both 
providers are responsible for propagating the customer routes to the rest of the Internet without 
doing any summarization. 


However, if the customer uses a small block of addresses that is assigned by one of the ISPs, an 
alternative design, not involving BGP, is to use two different PA address spaces and do 
Network Address Translation (NAT). With NAT, the router translates traffic going out over 
one of its connections to one of the PA addresses. If traffic goes out the other way, the 
addresses are translated to an address from the address space of the other provider. 
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Multihomed Customer AS Number Selection 


This topic describes the different AS numbering strategies that are available to a multihomed 
customer that is connected to multiple service providers. 


Multihomed Customer 
AS Number Selection 


Registered, public AS number (recommended): 
° Preferred option, but difficult to get 

* Does not require ISPs to assign a private AS number 
* Consistent routing information in the Internet 


Private AS number (discouraged): 


* Easier to get (even easier with AS translation) 


— One private AS number: Customer has to be able to use the 
same private AS number with multiple providers. 


— Multiple private AS numbers: Customer gets a private AS 
number assigned by each provider and uses one of them 
internally; the others have to be translated. 


* Causes inconsistent routing information 


The use of BGP requires an AS number. The preferred option is to use a registered, public AS 
number. However, registered AS numbers are assigned only to those who really need it because 
public AS numbers are a scarce resource. A customer with BGP sessions to multiple ISPs must 
use a registered, public AS number. A customer that is connected to only one ISP does not 
require a public AS number. In that case, a private AS number in the range 64512-65535 is 
sufficient. 


Whenever the customer has a public AS number assigned, there are no conflicts in the BGP 
setup, because the number is guaranteed to be unique within the Internet. Route announcements 
are made by both the customer and service provider without tampering with the AS path. As a 
result, consistent AS-path information is propagated by the service provider to the rest of the 
Internet. 


In those cases where the customer does not have a public AS number, it must use a private AS 
number. Because private AS numbers are not propagated to the Internet, several network 
administrators can, independently of each other, make this assignment. In this case, AS 
numbers are reused, which conserves AS number space. A service provider normally assigns 
private AS numbers to its customers. This arrangement ensures that unique private AS numbers 
are used among the customers of a single ISP. 
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In the case where a customer is going to be multihomed and the private AS number that has 
already been assigned by one of the ISPs comes in conflict with an AS number that has been 
assigned by the other ISP, the customer needs to consider renumbering of the customer AS. If 
the two service providers can reach a common agreement on which private AS number that the 
multihomed customer should use, renumbering is a solution. If no common agreement can be 
made or if renumbering, for some reason, is not an option, AS translation must be configured 
on the customer network. 


No router should ever propagate private AS numbers to the rest of the Internet. An ISP can 
keep track of which private AS numbers that it has assigned to its customers and avoid reuse or 
conflicts within that scope. However, as soon as the scope is widened to include other ISPs, 
conflicts will happen. Each ISP, therefore, removes private AS numbers from the AS path 
before sending routes outside its own AS. 


When the routes, with the private AS numbers removed, are propagated to the rest of the 
Internet, the AS path looks like the routes were originated within the public AS of the ISP. All 
information about the private AS lying behind the public AS is lost. In the case of a 
multihomed customer, the customer routes are, in the first step, propagated into each of the 
autonomous systems of its ISPs. In the next step, the routes have the private AS number 
removed as the routes are propagated to the rest of the Internet. Now the customer routes 
appear to be originating in the autonomous systems of both ISPs. To an outside observer, there 
is now an AS-path inconsistency because it looks like the same route belongs to different 
autonomous systems. 
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AS Number Translation 


This topic describes the operation of AS number translation. 


AS Number Translation 


AS 123 


— 


ee F* 
borers 
Service 


Provider A 


Customer 


Provider B 


* On one EBGP adjacency, the real AS number is used. 


* On the other EBGP adjacency, the AS number is translated to 
the one assigned by the second ISP. 


The figure shows a case where a customer is multihomed but forced to use two private AS 
numbers (for example, because of the scarcity of public AS numbers). 


In the figure, service provider A has assigned the private AS number 65053 to the customer. 
Service provider B did not agree to use this private AS number when connecting to the 
customer. Instead, service provider B has assigned the private AS number 65286. 


The customer now has two different private AS numbers: 65053 and 65286. The customer 
decides to use 65053 internally. All router BGP configuration lines have 65053 as the AS 
number. The customer uses AS number 65286 only when establishing the EBGP session to AS 
234. 


In the example, service provider A (AS 123) has an EBGP session to the customer where the 
AS number 65053 is used at the customer end. Service provider B (AS 234) has an EBGP 
session to the customer where the AS number 65286 is used at the customer end. Translation 
between these two private AS numbers takes place in the customer edge router as part of the 
EBGP session to AS 234. 
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router (config-router) # 


neighbor ip-address local-as private-as 


* Optionally, the customer can get two different private AS 
numbers assigned by the service providers. 


Internally, the customer can use an ISP-assigned AS 


number or even any other private AS number. 


Externally, the customer is seen as one private AS number 
to ISP 1, and as a different AS to ISP 2. 


Note: When you are using this option, the AS path of the 
customer network contains two AS numbers. ISP has to 
adapt the incoming AS-path filters. 


The neighbor ip-address local-as private-as router configuration command is used to indicate 
the AS number that the local router uses as its local AS number in the BGP Open message. The 
remote router is assumed to have an EBGP session to the indicated local AS. 


Internally, the customer network uses another private AS number. When routes are sent to the 
neighbor, the internal AS number is automatically prepended in the AS path first, and then the 
specified local AS number is prepended as well. As a consequence, the ISP receives the routes 
with an AS path with both AS numbers in it. The ISP has to adapt its incoming filter-lists as a 
result of this situation. 


Note Some service providers might be unwilling to change their AS-path input filters, leaving the 
customer no other option than to use a public AS number or to connect to a single ISP with 
a private AS number. 
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Primary/Backup Link Selection 


This topic describes how you can implement a typical backup setup between a multihomed 
customer and multiple service providers in a BGP environment. 


Primary/Backup Link Selection 


Outgoing link selection: 


¢ You can use the same solution as with multihomed 
customers connected to one service provider 


Incoming link selection: 


e You cannot use the MED because it can be sent 
only to the neighboring AS and no farther 


* You must use other means such as BGP 
communities or AS-path prepending to achieve 
incoming link selection 


When using BGP on multiple links between a customer and several service provider networks, 
the customer is solely responsible for controlling the use of the links between them for outgoing 
traffic. The customer chooses whether to use these links in a primary/backup or a load-sharing 
configuration. 


If one link is primary and the other is used for backup purposes only, the customer can use the 
local preference attribute in the configuration to direct all outgoing traffic over the primary link. 
This configuration is no different than the configuration that is used for customers with 
multiple connections running BGP to a single service provider. 


Controlling the load distribution of incoming traffic over multiple links is more difficult in the 
multihomed scenario when links to multiple service providers are used. You cannot use the 
MED when the customer connects to multiple providers because the updates are sent to two 
different autonomous systems. Recall that the MED is used only when you compare routes that 
are received from a single directly connected AS over two parallel links. Therefore, route 
selection decisions will most likely use the AS-path attribute and prefer the route with the 
shortest AS-path length. 
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BGP Incoming Link Selection 


This topic describes the use of BGP attributes to influence inbound link selection in customer 
networks that are multihomed to multiple service providers. 


BGP Incoming Link Selection 


¢ BGP communities: 


—Customer sets the appropriate BGP community 
attribute on updates sent to the backup ISP. 


—Requires the ISP to translate the BGP community 
attribute to a local preference attribute that is lower 
than the default value of 100. 


— May not work in all situations. 
° AS-path prepending: 


—Multiple copies of customer AS number are 
prepended to the AS path to lengthen the AS path 
sent over the backup link. 


—Customer is not dependent on the provider 
configuration. 


— Always works. 


jems, Inc. All rights reserve 


In order to remove incoming traffic from the backup link, the customer must influence route 
selection in the backup AS. The backup ISP must be forced to prefer the primary path to reach 
the customer network, although this choice means selecting a route with a longer AS path. 


One way to influence route selection is to use local preference in the network of the backup 
ISP. Using local preference creates an administrative scalability issue if each customer requires 
its use, because the ISP must maintain the configuration. 


One scalable way of setting local preference in an ISP network is to use communities. The 
customer sets a well-known community value on the routes that are sent to the backup ISP. The 
ISP recognizes the community and sets the local preference for these routes. This solution is 
available only if the ISP has implemented and announced the use of communities. If 
communities and a local preference setting are used, route selection occurs only if there are 
alternative routes to compare. 


Another way of influencing route selection in the backup ISP is to do AS-path prepending 
before sending the advertisement to the backup ISP. When the customer sends routes over the 
backup link, multiple copies of its own AS number are prepended to the AS path of each route. 
The backup ISP receives the routes and makes normal route selection decisions. No special 
weight or local preference settings are used; the BGP route selection is based exclusively on the 
AS-path length. No special configuration is required in the service provider network. 
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In the example here, the backup service provider B (AS 234) has defined the meaning of 
community 234:50. When AS 234 receives routes with this community, the local preference is 
set to 50. 


The customer AS 387 is advertising the route over the primary link without any communities. It 
is received by AS 123 and propagated to AS 234. When AS 234 receives the route via AS 123, 
there is no community set. AS 234 therefore assigns the default local preference value of 100. 


The customer is also advertising the route over the backup link. However, in this case, the route 
has the community 234:50 set. When AS 234 receives this route, it recognizes the community, 
and the local preference value is set to 50. 


Route selection is now performed in AS 234. The route that has been received via AS 123 is 
preferred based on the local preference values. 
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BGP Incoming Link Selection Using 
BGP Communities (Cont.) 
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Even when the use of communities is correctly configured, the desired load distribution may 
not always be achieved. As this example shows, AS 234 does not always receive the primary 
route, although nothing is wrong in the network. 


The customer AS 387 sends routes with community 234:50 over the backup link to AS 234. AS 
234 receives the routes and sets the local preference to 50. If AS 234 over some period of time 
selects the directly connected path to AS 387 as the best, it propagates the route to AS 321. As 
the route is propagated over the EBGP session between AS 234 and AS 321, the local 
preference value that is used within AS 234 is lost. 


AS 321 does not have any use for the community 234:50 because this community is defined 
and implemented only within AS 234. Potentially, the community value can also be stripped off 
during BGP route propagation. 


Customer AS 387 also sends the routes over the primary link to AS 123. The routes are 
propagated to AS 321, which now sees two alternative routes to the destination networks within 
AS 387. Neither weight nor local preference is used by the routers in AS 321 as criteria for 
reaching AS 387. Both alternatives have equal AS-path length. 


The route selection decision that will be made in AS 321 is hard to predict, but the outcome 
definitely influences the route selection decision that was made in AS 234. If AS 321 prefers 
the route to the customer network via AS 234 for any reason, then the second-best alternative 
via AS 123 and the primary link is never propagated to AS 234. 


In this case, AS 234 never sees the primary path and has to stick to the backup link and 
announce the route to AS 321. The network has reached a steady state when the traffic uses the 
backup link although the primary link is available. 
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BGP Incoming Link Selection Using 
AS-Path Prepending 
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In this example, the customer AS 387 is performing AS-path prepending on the backup link. 
Three copies of the customer AS number (387) are prepended to the AS path. As the route goes 
out over the EBGP session, BGP prepends the local AS number to the AS-path attribute. AS 
234 receives routes from AS 387 over the backup link with an AS-path length of four (the 
original AS 387 plus three prepended copies that the customer edge router applied to the AS- 
path attribute). 


The customer advertises networks without AS-path prepending over the primary link. AS 123 
receives routes with an AS-path length of one and propagates these routes to AS 321, which 
then receives them with an AS-path length of two. 


If, for a short period of time, AS 321 received the customer routes via AS 234, the AS-path 
length of those routes would have been five. In that case, AS 321 selects the route from AS 123 
as the best and propagates it to AS 234. 


AS 234 now sees both alternatives. The customer routes that have been received directly from 
the customer have an AS-path length of four. The routes that have been received via AS 321 
have an AS-path length of three. Because no weight or local preference is configured in this 
example, AS 234 selects the route via AS 321 as the best. 


The desired result, to have all traffic enter the customer network via the primary link, is now 


achieved. 

Note If the backup ISP is implementing incoming AS-path filters for this customer with the length 
of the AS path equal to one, the ISP has to change the configuration of the AS-path filter for 
the customer. The ISP can either create a new filter, allowing multiple copies of the 
customer AS number only for this customer, or use regular expression variables to create a 
common filter for all customers that belong to one peer group. 
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Load Sharing with Multiple Providers 


5-86 


This topic describes how you can implement load sharing between a multihomed customer and 
multiple service providers in a BGP environment. 


Load Sharing with Multiple Providers 


Load sharing for outgoing traffic: 


¢ You can use the same solution as with multihomed 
customers connected to one service provider. 


Load sharing for incoming traffic: 


¢ The only load-sharing option that you can use in this 
setup is to separate address space into two or more 
smaller address blocks. 


* Some traffic analysis is needed to fine-tune address 
space separation according to link bandwidths. 


* You should use AS-path prepending to ensure 
symmetric routing as well as backup for 
noncontiguous address blocks. 


Load sharing over links to two different ISPs can be compared to doing load sharing over two 
parallel links to a single ISP. The only difference is that there is only one option that is 
available to control incoming traffic. Controlling load distribution of the outgoing traffic is 
configured in exactly the same way as when a multihomed customer connects to a single 
service provider. 


The customer can control the load distribution of incoming traffic based on traffic destination. 
The customer divides its address space into several announcements. One announcement is sent 
to one of the ISPs. Another announcement is sent to the other ISP. For backup purposes, the 
customer announces the entire address space to both ISPs. The ISPs now use the most explicit 
route rule, and as long as both links are up, traffic with destinations within one part of the 
customer address space is routed over one of the links and traffic to the other part is routed over 
the other link. 


It is very difficult to predict the volume of traffic that will be directed to one part of the 
customer address space and the volume that will be directed to the other part. You should 
monitor the results of changing route updates by watching the load on the links before and after 
implementing the change. If the load distribution is not satisfactory, you can further modify the 
division of the address space. You must then check the load on the links again and further fine- 
tune the configuration. 
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A customer may decide to use both the division of address space into several advertisements 
and AS-path prepending together. Some part of the customer address space may be advertised 
by the customer network with a longer AS path over one of the links to fine-tune the load. Also, 
there may be cases where there are noncontiguous subnets that cannot be divided because the 
prefixes would be too long. These subnets are evenly distributed between the links in a 
primary/backup configuration. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
CONE ad 


* Customers that require the maximum redundancy in their 
network design should implement a configuration that is 
multihomed to multiple service providers. 


A customer that is multihomed to multiple BGP service 
providers must advertise its address space to both ISPs 
as well as take care not to transmit any routing 
information between the two ISPs. 


The internal addresses of the customer must be 
advertised to both ISPs. Depending on the addressing 
scheme that is used by the customer, NAT may be 
required. 


Customers that are connected to only one ISP do not 
require a public AS number, while customers connected 
to multiple ISPs must use an AS number that all ISPs 
agree to. 


Summary (Cont.) 


* You can use AS number translation to prepend a different 
AS number to the AS path, which allows the customer to 
use a single private AS number in the network. 


Outgoing route selection in primary/backup connectivity 
is achieved using local preference. Incoming route 
selection should be implemented using either BGP 
communities to tag customer routes or AS-path 
prepending. 


Load-sharing configurations for outgoing traffic are the 
same as those used in the scenario in which the 
customer is multihomed to a single provider. You can 
perform load sharing of incoming traffic when you are 
multihomed to multiple providers only if separate address 
spaces are advertised to each provider. You can also use 
AS-path prepending of this configuration for fine-tuning 
purposes. 
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References 


For additional information, refer to these resources: 


m= For more information on the BGP local AS feature, refer to “Configuring the BGP Local- 
AS Feature” at the following URL: http://www.cisco.com/warp/public/459/39.html 


m= For more information on load sharing, refer to “Sample Configurations for Load Sharing 
with BGP in Single and Multihomed Environments” at the following URL: 
http://www.cisco.com/warp/public/459/40.html 
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Lesson Assessments 


Overview 


Use the lesson assessments here to test what you learned in this module. The correct answers 
and solutions are found in the Lesson Assessment Answer Key. 


Outline 


This section includes these assessments: 

@ Quiz 5-1: Understanding Customer-to-Provider Connectivity Requirements 
@ Quiz 5-2: Implementing Customer Connectivity Using Static Routing 

@ Quiz 5-3: Connecting a Multihomed Customer to a Single Service Provider 


@ Quiz 5-4: Connecting a Multihomed Customer to Multiple Service Providers 
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Quiz 5-1: Understanding Customer-to-Provider 
Connectivity Requirements 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 


Quiz 


Identify different physical connections that are used by customers to connect to a service 
provider 


Describe the levels of redundancy that are provided by each physical connection type that 
is used by customers to connect to a service provider 


Identify different routing schemes that are used by customers to connect to a service 
provider 


Describe routing schemes that are appropriate for each physical connection type that is 
used by customers to connect to a service provider 


Describe the addressing schemes that are used by customers to connect to a service 
provider 


Describe the AS numbering schemes that are used by customers to connect to a service 
provider 


Answer these questions: 


Q1) If acustomer requires additional bandwidth as well as redundancy, which approach is 
preferred? 
A) a single permanent connection to one ISP 
B) permanent connections to more than one ISP 
C) dial-up connections to more than one ISP 
D) multiple permanent connections to one ISP 

Q2) ~~ Which type of redundancy do multiple permanent connections that provide load- 
sharing configuration display? 
A) link 
B) equipment 
C) service provider 
D) routing protocol 

Q3) Ina customer-to-provider routing scheme, which method of routing is preferred 
because of its lower complexity? 
A) policy-based routing 
B) dynamic routing 
C) content routing 
D) static routing 
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Q4)  ~Why is it that with multiple permanent connections to more than one ISP, the use of 
dynamic routing with BGP is required? 


A) When one of the connections is lost, the link level detects this loss and places 
the interface in a down state. 

B) Monitoring of the link status cannot detect a problem inside one of the ISP 
networks. 

C) Static routes detect problems inside one of the ISP networks. 

D) It is not required, and static routing may be used. 


Q5) — What can be done when a customer is assigned only a very small subnet of public 


addresses? 

A) purchase more addresses as required 
B) use NAT 

C) add a service provider 

D) add links to the same service provider 


Q6) What are two different addressing schemes that customers use to connect to a service 
provider? (Choose two.) 


A) provider-independent 
B) customer-independent 
C) provider-assigned 
D) customer-assigned 


Q7) — Which two of the following criteria are required for a customer to be multihomed to 
multiple ISPs? (Choose two.) 


A) The customer must have a public AS number. 
B) The customer must have a private AS number. 
C) The customer must run BGP with both of its ISPs. 
D) The customer must run BGP with one ISP and may use static routing with the 
other. 
Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 5-2: Implementing Customer Connectivity 
Using Static Routing 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 


Quiz 


Identify when to use static routing between a customer and a service provider in a BGP 
environment 


Describe the characteristics of static routing between a customer and a service provider in a 
BGP environment 


Identify design considerations for propagating static routes in a service provider network 
Configure static route propagation in a BGP environment with different service levels 


Configure a typical backup setup that uses static routing between a customer and a service 
provider in a BGP environment 


Describe the limitations of floating static routes when they are used in typical backup static 
routing scenarios and the corrective actions to overcome these limitations 


Describe the characteristics of load sharing when you are configuring static routing 
between a customer and a service provider 


Answer these questions: 


Q1) ~~ What are two requirements for being able to use static routing as part of installing 
redundant connections between the customer network and a single service provider 
network? (Choose two.) 

A) The router must be able to detect a link failure. 

B) The default route must be announced using the customer IGP. 

C) If one link goes down, the interface must remain in an up state. 

D) The customer IGP must continue to advertise the static default route. 

Q2) A customer route that should not be announced to the rest of the Internet is marked 
using what? 

A) a route tag 

B) the export community 

C) the no-export community 
D) the public address filter 

Q3) | When you are designing static route propagation in a service provider network, which 

three steps must you take? (Choose three.) 
A) assign a tag to each combination of services 
B) configure a community that matches defined tags 
C) redistribute static routes into BGP through a route-map 
D) identify all possible combinations of services that are offered to a customer 
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Q4) ~~ What does a route-map assign that will be used by other routers within a network? 


A) a tag 

B) community values 
C) public addressing 
D) QoS 


Q5) — Which three key pieces of information can you derive from the following router 
command output? (Choose three.) 


AS387 Backup# sh ip bgp 11.2.3.0 
BGP routing table entry for 11.2.3.0/24, version 7 
Paths: (2 available, best #1, not advertised to EBGP peer) 
Advertised to non peer-group peers: 
TOs So's 5 
Local 
0.0.0.0 from 0.0.0.0 (10.3.0.6) 
Origin incomplete, metric 0, localpref 100, weight 32768, valid, 
sourced, best 
Community: 387:31000 no-export 
Local 
10.3.0.2 (metric 128) from 10.3.0.5 (1.0.0.2) 
Origin incomplete, metric 0, localpref 100, valid, internal 
Originator: 1.0.0.2, Cluster list: 10.3.0.5 
Community: 387:31000 no-export 


A) The primary link has come back, so the backup router now sees two alternate 
routes. 

B) The primary link has not come back up, but the backup router still sees two 
alternate routes. 

C) The first route is the route that the router itself has redistributed into BGP using 


the floating static route. This route is locally sourced by the AS and has been 
assigned a weight value of 32768. 

D) The second route is the one that has been received by IBGP from the primary 
edge router. The AS also sources this route, but no weight value is assigned. 


Q6) = Which two things can you do to overcome the problems that occur when a floating 
static route is redistributed into BGP? (Choose two.) 


A) You must raise the weight value. 

B) You must lower the weight value. 

C) You must set the AD at a higher value than all other routes. 

D) You must assign local preference values, giving the floating static route a 


lower local preference value than the primary route. 


Q7) — What are three characteristics of using static routes during load sharing of outgoing 
traffic? (Choose three.) 


A) Outgoing traffic load sharing is easy to achieve. 

B) Each customer router uses the closest customer edge router as the exit point. 
C) Balanced load sharing is achieved if the customer edge routers are collocated. 
D) Local preference values must be assigned, giving the floating static route a 


lower local preference value than the primary route. 


Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 5-3: Connecting a Multihomed Customer to 
a Single Service Provider 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 


= Configure BGP on a customer network to establish routing between a multihomed 
customer and a single service provider 


= Configure conditional advertising of a customer address space when BGP is used to 
establish routing between a multihomed customer and a single service provider 


™ Configure BGP on a service provider network to establish routing between a multihomed 
customer and a single service provider 


m Disable the propagation of private AS numbers to EBGP peers in a service provider 
network where a multihomed customer is advertising private numbers in the AS path 


™ Configure a typical backup setup between a multihomed customer and a single service 
provider in a BGP environment 


m= Describe how you can implement load sharing between a multihomed customer and a 
single service provider in a BGP environment 


m Identify the Cisco IOS command that is required to configure load sharing between a 
multihomed customer and a single service provider using BGP multipath 


™ Configure load sharing between a multihomed customer and a single service provider using 
EBGP multihop 


Quiz 
Answer these questions: 


Q1) ~~ What are three responsibilities of the customer when the customer is multihomed to a 
single service provider? (Choose three.) 


A) Customer edge routers must run IBGP between them. 
B) The customer must advertise a default route. 
C) The customer must conditionally advertise its assigned address space into 
BGP. 
D) The customer edge routers must run EBGP with the provider. 
5-96 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 


The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Q2) Given the following router command output, which method has been used to influence 
return traffic in a primary/backup link implementation for this multihomed customer? 
Provider# show ip bgp 
BGP table version is 5, local router ID is 10.0.33.34 
Status codes: s suppressed, d damped, h history, * valid, > best, i - 
internal 
Origin codes: i - IGP, e - EGP, ? - incomplete 

Network Next Hop Metric LocPrf Weight Path 
* 10.10.20.0/24 192.168.63.3 1000 0 100 100 i 
*> 192.168.64.4 2000 0 400 100 i 
*> 30.30.30.0/24 192.168.63.3 0 0 100 I 
*> 40.40.40.0/24 192.168.64.4 0 0 400 I 
A) MED 
B) local preference 
C) weight 
D) AS-path prepending 

Q3) What are three responsibilities of the provider router when supporting a multihomed 

customer? (Choose three.) 

A) The provider must advertise a default route to the customer through BGP. 

B) The provider must filter customer routes to verify that proper addressing is 
used. 

C) The provider must remove the private AS number, if it is in use by the 
customer. 

D) The provider must configure new AS-path filters to allow AS-path prepending; 
otherwise, a primary/backup link cannot be established. 

Q4) ~~ What will occur if private AS numbers are advertised to the Internet? 

A) The Internet will not be able to route packets. 

B) Internet routers could drop routes based on BGP loop prevention mechanisms. 

C) Customer load balancing will not function. 

D) Customer configurations for the primary/backup link using AS-path 
prepending will not function. 

Q5) | Which two BGP configurations are required to properly implement a backup solution 
for a multihomed customer that is connected to a single provider? (Choose two.) 

A) The customer should set local preference to influence outgoing route selection. 

B) The customer should set the weight attribute to influence outgoing path 
selection. 

C) The customer should set the MED on each route to influence return path 
selection. 

D) The customer should configure AS-path prepending to ensure proper outgoing 
path selection. 
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Q6) Acustomer router has been configured with maximum paths set to a value of 4. Given 
the following router command output, over how many links will the router need to 
perform load balancing? 
router# show ip bgp 
BGP table version is 5, local router ID is 10.0.33.34 
Status codes: s suppressed, d damped, h history, * valid, > best, i - 
internal 
Origin codes: i - IGP, e - EGP, ? - incomplete 

Network Next Hop Metric LocPrf Weight Path 

* 10.10.20.0/24 192.168.63.3 0 300 100 

100 i 

*> 192.168.64.4 0 400 100 i 

* 192.168.65.5 0 500 100 i 

*> 30.30.30.0/24 192.168.63.3 0 0 300 i 

*> 40.40.40.0/24 192.168.64.4 0 0 400 i 

A) The router will use only the path marked as “best” by BGP. 

B) The router will perform load balancing over two paths to reach network 
10.10.20.0/24. 

C) The router will perform load balancing over three paths to reach network 
10.10.20.0/24. 

D) There is not enough information to determine the correct answer. 

Q7) — Which three methods can you use to provide load sharing over network links between a 

multihomed customer and a single provider? (Choose three.) 

A) advertising of split addressing space to the provider 

B) configuring ebgp-multihop between the customer and the provider 

C) using the BGP maximum-paths command to perform load balancing over 
parallel links 

D) configuring multiple static routes that point to the provider 

Q8) Why is it not required to configure maximum paths under the BGP routing process 
when are performing load balancing with the ebgp-multihop command? 

A) By default, BGP will perform load balancing over up to four paths, 
configurable up to six. 

B) The static route or IGP process is responsible for load balancing in this 
configuration. 

C) Configuring multihop enables maximum paths equal to the TTL setting of the 
neighbor ebgp-multihop command. 

D) Configuring ebgp-multipath is a required component of ebgp-multihop load 
balancing. 

Scoring 

You have successfully completed the quiz for this lesson when you earn a score of 80 percent 

or better. 

5-98 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 


The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Quiz 5-4: Connecting a Multihomed Customer to 
Multiple Service Providers 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 


m™ Describe BGP configuration characteristics that are used to establish routing between a 
multihomed customer and multiple service providers 


m Describe addressing strategies that are available to a multihomed customer that is 
connected to multiple service providers 


m Describe AS numbering strategies that are available to a multihomed customer that is 
connected to multiple service providers 


m Describe the operation of AS number translation 


m Describe how you can implement a typical backup setup between a multihomed customer 
and multiple service providers in a BGP environment 


= Describe the use of BGP attributes to influence inbound link selection in customer 
networks that are multihomed to multiple service providers 


m™ Describe how you can implement load sharing between a multihomed customer and 
multiple service providers in a BGP environment 


Quiz 
Answer these questions: 


Q1) A multihomed customer is using AS number 65550 internally. The customer is 
connected to two different providers. Provider 1 (in AS 222) has assigned the customer 
an AS number of AS 65101. Provider 2 (in AS 333) has assigned the customer an AS 
number of AS 65201. Given that the customer will use AS number translation for its 
internal AS, what is the AS-path attribute (attached to routes that originated in the 
customer network) that will be displayed on a router in the network of Provider 2? 

A) 65550 i 
B) 65201 i 


C) 65201 65550 i 
D) 333 65201 i 


Q2) — Which three methods can you use to provide load sharing over network links between a 
multihomed customer and multiple providers? (Choose three.) 


A) advertising of split addressing space to the provider 

B) configuring of multiple static routes that point to the provider 

C) using the BGP maximum-paths command to perform load sharing over 
parallel links 


D) AS-path prepending to fine-tune the load-sharing configuration 
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Q3) What are three BGP configuration characteristics of a multihomed customer that is 
connected to multiple providers? (Choose three.) 


A) The customer announces assigned addressing to its providers through BGP. 

B) The customer announces a default route to its network through BGP. 

C) The provider announces a default route, local routes, or full Internet routing to 
the customer via BGP. 

D) The customer configures outbound filters to prevent its network from 


becoming a transit area. 


Q4) A multihomed customer is using AS number 1024 and is connected to two different 
providers (Provider 1: AS 222 and Provider 2: AS 333). The customer has configured 
the MED to ensure a proper return path so that Provider 1 is the primary provider and 
Provider 2 is the backup provider. Unfortunately, return traffic continues to use the 
backup link. What is a possible cause of this problem? 


A) The backup provider is ignoring the MED attribute on received routes. 

B) The MED attribute cannot be sent to the backup provider because it is local to 
AS 1024 only. 

C) The customer has not set the proper BGP communities to allow the primary 
and backup providers to correctly set the MED attribute. 

D) The MED cannot be used in this scenario, because it will not be advertised to 


providers upstream of Provider 2. 


Q5) — What are three important considerations for customers that wish to connect to multiple 
providers? (Choose three.) 


A) The customer has to consider whether to use PA or PI address space. 

B) The customer has to decide whether to use static routes or BGP to connect to 
upstream providers. 

C) The customer has to decide whether to use a public AS number or a private AS 
number scheme. 

D) The customer has to decide whether to perform load sharing or use a 


primary/backup implementation over redundant links. 


Q6) Which AS number selection is the best possible choice for a customer that is 
multihomed to multiple providers? 


A) a single public AS number 


B) a single private AS number 

C) two private AS numbers that are used in conjunction with AS number 
translation 

D) multiple private AS numbers, one used internally by the customer and the 


others used in conjunction with AS number translation for each provider 
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Q7) — Given the following router command output, which two methods have been configured 
to influence return traffic in a primary/backup link for this multihomed customer? 
(Choose two.) 

Provider# show ip bgp 
BGP table version is 5, local router ID is 10.0.33.34 
Status codes: s suppressed, d damped, h history, * valid, > best, i - 


internal 
Origin codes: i - IGP, e - EGP, ? - incomplete 


Network Next Hop Metric LocPrf Weight Path 
* 10.10.20.0/24 192.168.63.3 2000 0 100 100 
100 i 
*> 192.168.64.4 0 300 100 i 
*> 30.30.30.0/24 192.168.63.3 0 0 300 100 i 
*> 40.40.40.0/24 192.168.64.4 0 0 100 i 
A) MED 
B) local preference 
C) split address advertisement 


D) AS-path prepending 


Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Lesson Assessment Answer Key 


Quiz 5-1: Understanding Customer-to-Provider Connectivity Requirements 


Ql) D 
Q2) A 
Q3) D 
Q4) B 
Q5) B 
Q6) A,C 
Q7) Apc 


Quiz 5-2: Implementing Customer Connectivity Using Static Routing 


Ql) A,B 
Q2) C 

Q3) A,C,D 
Q4) B 

Q5) A,C,D 
Q6) B, D 


Q7) A,B,C 


Quiz 5-3: Connecting a Multihomed Customer to a Single Service Provider 


Ql) A,C,D 


Q2) A 

Q3) Ae 
Q4) B 

Q5) AC 
Q6) B 

Q7) A,B,C 
Q8) B 


Quiz 5-4: Connecting a Multihomed Customer to Multiple Service Providers 


5-102 


Ql) C 
Q2) A,C,D 
Q3) A,C,D 


Q4) D 

Q5) A,C,D 
Q6) A 

Q7) C,D 
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Module 6 


Scaling Service Provider 
Networks 


Overview 


Common to every service provider network are concerns over network scalability, specifically 
when the network supports both internal applications and customer connectivity. When interior 
and exterior routing protocols are deployed in large, complex service provider networks, 
protocol interaction, Interior Gateway Protocol (IGP) choice, and addressing are common 
concerns. Proper scaling of Internal Border Gateway Protocol (IBGP) within the service 
provider network is also an area of concern. 


In standard Border Gateway Protocol (BGP) implementations, all BGP routers within an 
autonomous system (AS) must be fully meshed so that all external routing information can be 
distributed among the other routers that reside within the AS. Therefore, within an AS, all 
routers must establish TCP sessions with all other BGP routers. As the AS grows, scalability 
challenges arise because of an ever-increasing number of TCP sessions and demands for router 
CPU and memory resources. 


This module discusses network scalability concerns that are common to large, complex service 
provider networks. The module also discusses BGP route reflectors and confederations as 
scalability mechanisms that allow network designers to steer away from BGP full-mesh 
requirements and improve network scalability by reducing the number of TCP sessions that are 
required within an AS. Also discussed in this module are the Cisco IOS commands that are 
needed to configure and monitor BGP route reflectors and confederations. 


The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Module Objectives 


Upon completing this module, you will be able to describe network scalability issues that are 
common to service provider networks. 


Module Objectives 


Describe common routing scalability concerns in service 
provider networks 


Describe the function and operation of route reflectors in 
a BGP environment 


Describe the concept of hierarchical route reflectors and 
their requirements, based upon established route reflector 
design rules 

Configure and verify proper operation of route reflectors 


to modify IBGP split-horizon rules in an existing IBGP 
network 


Describe the function and operation of confederations ina 
BGP environment 


Configure and verify proper operation of confederations 
to modify IBGP AS-path processing in an existing IBGP 
network 


BGP v3.1—6-2 


Module Outline 


The outline lists the components of this module. 


Module Outline 


* Scaling IGP and BGP in Service Provider Networks 
° Introducing Route Reflectors 

* Designing Networks with Route Reflectors 

* Configuring and Monitoring Route Reflectors 

* Introducing Confederations 


* Configuring and Monitoring Confederations 


BGP v3.1—6-3 
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scaling IGP and BGP in 
Service Provider Networks 


Overview 


Common to every service provider network are concerns about network scalability. The 
interactions between IGPs and the BGP, specifically when network administrators are 
supporting internal routing, customer connectivity, and transit traffic (and the administrative 
policies that match), can be quite complex. Furthermore, the large number of prefixes that are 
required to support full Internet routing requires administrators to fully characterize IGP and 
BGP interactions for internal networks and customers alike. 


This lesson discusses network scalability concerns common to large, complex service provider 
networks. Included in this lesson is a description of a typical service provider network, and 
discussion of the propagation of internal and customer routing information, scaling 
considerations for IGPs and BGP, and scaling of IP addressing in service provider networks. 


Relevance 


Properly scaling IP addressing, IGPs, and BGP is a common area of concern to all service 
providers and can be the difference between a successful and a problematic BGP 
implementation. Because service provider networks are complex and must meet the 
administrative policy and routing demands of the internal network, different customers, and 
other providers, proper scaling is crucial to the success of the network. 


Objectives 


Upon completing this lesson, you will be able to describe common routing scalability issues in 
service provider networks. This includes being able to meet these objectives: 


m Describe the basic structure of service provider networks 
m= Describe the propagation of internal and customer routes in service provider networks 
m Describe proper scaling of IGPs and BGP in service provider networks 


m™ Describe issues concerning the scaling of IP addressing in service provider networks 
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Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
— iS ci] 


° Overview 
¢ Common Service Provider Network 


¢ Route Propagation in Service Provider 
Networks 


° Scaling Service Provider Routing Protocols 


° Scaling Service Provider Addressing 


° Summary 
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Common Service Provider Network 


This topic describes the basic structure of service provider networks. 


Common Service Provider Network 


¢ Runs BGP or static routing with customer 


° Exchanges routes with other service 
providers via BGP 


° Runs IBGP between its own BGP speakers 


¢ Runs one instance of IGP (OSPF or IS-IS) 
—IGP used for internal routes only 


The common service provider network runs External Border Gateway Protocol (EBGP) or 
static routing with customers. EBGP is always used as the routing protocol between different 
service providers. 


IBGP is required in the provider network because all EBGP-speaking routers in an AS must 
exchange external routes via IBGP. Also, non-EBGP speakers are required to take part in the 
IBGP exchange if they are in a transit path and forward packets based on destination IP 
addresses. 


The service provider network also runs an IGP. The protocols of choice are Open Shortest Path 
First (OSPF) and Intermediate System-to-Intermediate System (IS-IS). The IGP is used for two 
purposes: 


m™ Provides IP connectivity between all IBGP speakers so that TCP sessions for IBGP can be 
established between BGP-speaking routers 


m Provides optimal routing to the BGP next-hop address 


A single IGP should be used within the entire AS. This setup facilitates effective packet 
forwarding from the ingress router to egress routers. The IGP is configured to carry internal 
routes only, including internal links and loopback addresses of the routers. For performance and 
scalability reasons, no customer routes or external routes should be injected into the IGP. 
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Common Service Provider Network (Cont.) 


IGP Within IBGP Between 
Service a BGP Speakers of 
Provider Network = Service Provider 


EBGP or Static 


BGP v3.1—6-4 


The typical service provider network consists of a network core that connects various edge 
devices. Some of the edge devices connect customers; others connect to other service providers. 


The edge devices that connect to other service providers use EBGP to exchange routing 
information. The edge devices that connect customers use either static routing or EBGP. 


Unless Multiprotocol Label Switching (MPLS) is configured on the service provider backbone, 
routers in a transit path are also required to have full routing information. Therefore, these 
routers take part in the IBGP routing exchange. 


An IGP is also required within the service provider network. The IGP is used to carry internal 
routes, including the loopback interface addresses of IBGP-speaking routers. The IGP provides 
reachability information to establish IBGP sessions and to perform the recursive routing lookup 


for the BGP next hop. 
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Common Service Provider Network (Cont.) 


Dial-In Service Dial-In 
Provider 


wes a wes 
Leased Lines es Leased Lines 


Leased Lines 
POP3 
* Networks are divided into POPs. 
° Different types of media are concentrated at the POP. 
* Optimal routing between POPs is desired. 
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Service provider devices that connect access links to customers are physically located in groups 
that are called “points of presence” (POPs). In general, the POP is a group of routers where 
access links are terminated. The edge routers that peer with other service providers can in this 
sense be considered a POP. 


Service providers use different types of access links with different types of customers and 
usually mix access links in the same POP. Some customers use leased lines, others use xDSL, 
and still others use dial-in access or any other access that the provider can support. 


POP routers connect to the network core using a layer of concentration routers at the POP. The 
network core forwards packets between POPs, different customer access points, or peering 
points with other service providers. Optimal routing between POPs is a desirable feature. 
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Common Service Provider Network (Cont.) 


Service Provider Backbone 
— Static routing EEE : _ 
Customer ~ S Customer 
Router — Router 
BGP routing C BGP routing > 
<= POP Router Core Router POP Route << 


Customer Customer g 
Router Core IGP Router g 


* POP routers use BGP or static routing with customer 
routers. 


* Provider core IGP is a single instance of IS-IS or OSPF. 
* The core IGP is used only within the service provider 


backbone. 
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Customer access lines terminate in the POP edge routers. In many cases, the POP edge routers 
use static routing to customer networks. The POP edge routers advertise static routes to the rest 
of the service provider network and to other autonomous systems using BGP. 


Service providers use BGP routing with the customer when redundancy requires the use of a 


routing protocol. 


The service provider backbone typically uses a single instance of either IS-IS or OSPF as its 
IGP. The IGP is used within the provider backbone only. The provider backbone exchanges no 
IGP routing information with customer routers or with routers in other autonomous systems. 
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Route Propagation in Service Provider Networks 


This topic describes the propagation of internal and customer routes in service provider 
networks. 


Route Propagation in 
Service Provider Networks 


° BGP Route Propagation 
—BGP carries customer routes. 
—BGP carries other provider routes. 


° IGP Route Propagation 


—IGP responsible only for next hop. 


° Do not redistribute BGP into IGP 


—IGP performance and convergence time suffer if 
large number of routes are carried. 


—No IGP is capable of carrying full Internet routes. 


— Full Internet routing table has exceeded 110,000 
routes. 


It is important to avoid sending any unnecessary routing information in the IGP. The IGP 
performs best if it carries as few routes as possible. Optimally, the IGP should contain only 
information about BGP next hops and routes that are internal to the service provider network, 
enabling the establishment of IBGP sessions. 


All other routing information should be carried in BGP, which is designed to scale for large 
volumes of routing information. Customer routes and the routes from other service providers 
should be carried in BGP. These routes should not be propagated from BGP into the provider 
IGP. 


IGP performance and convergence time suffer if the IGP carries a larger number of routes. The 
design goal should be to minimize the volume of routing information that is carried by the IGP. 


Naturally, the number of route flaps is also reduced as the number of routes is reduced. 


BGP scales to a much larger volume of routing information because of the inherent qualities of 


the design of BGP. Potentially, the BGP routers of the service provider can receive the full 
Internet routing table, which has exceeded 110,000 routes. You should therefore never 
redistribute the routing information that has been received by BGP into the IGP, because no 
IGP is capable of carrying several tens of thousands of routes. 
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Routing Information Exchange 
with Other Service Providers 


* BGP is used to exchange routing information between 
Internet service providers. 
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Provider edge routers use BGP to exchange routing information with other service provider 
networks for redundancy and scalability reasons. 


Static routing with other service providers is generally not a viable solution due to the dynamic 
routing requirements of the service provider environment. Routing information is received at 
provider edge routers using EBGP and then propagated using IBGP to the rest of the service 
provider network. At another edge router, the routing information is further propagated to a 
different service provider using EBGP with other autonomous systems. 
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Routing Information Exchange 
with Customers 


Redistribution of 
static routes into BGP 


Static default route 


Customer Provider Provider 
Edge Router Edge Router Router 


Customer Network Service Provider Network 


* The provider edge router redistributes static customer 
routes into BGP. 


e BGP carries customer routes. 


0026_251 
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The provider edge router typically uses static routing to reach customer networks. In this case, 
the customer typically configures a static default route that points to the edge router of the 


service provider. 


The provider edge router redistributes customer static routes into BGP. The service provider 
network then uses BGP to propagate the information to the rest of the service provider network 
using IBGP. The service provider also advertises customer routing information to other 


autonomous systems using BGP. 
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Next-Hop Resolution 


Reachability for network 
13.0.0.0/8 via next hop 12.0.0.1 


13.0.0.0/8 12.0.0.1 Core 
Customer POP Router Router Router 
Network next-hop-self 


Service Provider Backbone 


How to reach 12.0.0.1 


002G_252 


* The core IGP of the service provider should carry information 


only about backbone links and loopback addresses. 
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The IGP used in the service provider core should carry information only about backbone links 
and loopback addresses. The service provider should use BGP to carry all other information. 


Use the BGP next-hop-self command when BGP routing is exchanged with the customer or 
other service providers. Using next-hop-self results in the BGP next hop being set to the 
loopback address of the service provider edge router and not to the access link address of the 
customer. The IGP can then be relieved from the burden of carrying information about the 
access link. The benefit of not carrying customer link information is that a flapping access link 


will not disturb the service provider IGP. 
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Scaling Service Provider Routing Protocols 


This topic describes proper scaling of IGPs and BGP in service provider networks. 


Scaling Service Provider 
Routing Protocols 


IGP Responsibilities 
* Carrying route to BGP next hop 
* Providing optimal path to the next hop 


* Converging to alternate path so that the BGP 
peering is maintained 


BGP Responsibilities 

* Generating BGP update 

* Scaling BGP policies 

* Scaling IBGP mesh 

¢ Reducing impact of flapping routes 


The IGP is responsible for the following: 
m™ Carrying routes to the BGP next hops to facilitate recursive routing 


m™ Providing an optimal path to the next hop, thereby optimizing packet flow toward all BGP 
destinations 


m™ Converging to an alternate path in the case of lost links or routers in a redundant network; 
convergence should be quick so that BGP sessions are not lost 

The BGP is responsible for the following: 

m™ Generating BGP updates about reachable and unreachable networks 


m= Implementing and scaling the BGP routing policy, which can be quite cumbersome in large 
service provider networks with many EBGP-speaking routers 


= Implementing and scaling IBGP sessions between all BGP-speaking routers in the AS 


m™ Reducing the impact of individual flapping routes through route summarization 
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Scaling Service Provider 
Routing Protocols (Cont.) 


Scaling IGP 
¢ Loopbacks and internal links carried only 
* Good addressing structure within the POP required 


¢ Loopback addresses taken out of a different address 
space and not summarized 


¢ Summarization of internal link addresses on POP level 


¢ Optimal routes to loopbacks needed only (with proper 
summarization) 


In scaling an IGP, it is important to limit the number of routes that are carried by the IGP. 
Optimally, the IGP carries only loopback interfaces and internal links. 


The number of routes that are carried by the IGP can be even further reduced with route 
summarization. However, care must be taken because loopback addresses should never be 
summarized. Route summarization always introduces the risk of suboptimal routing and should 
be carefully planned, because it is important that recursive routing lookup always use optimal 
routing to the next hop. Also, in an MPLS environment, a label switched path (LSP) must be 
unbroken between edge routers, and summarizing loopback interfaces will break the LSP. 


Internal links can always be summarized because they are not used as BGP next-hop addresses. 
To facilitate proper route summarization, internal links and loopback interfaces on a router 
should be assigned addresses from two different address spaces. Also, the internal links of a 
router should be assigned addresses depending upon which POP the routers belong to. 


If implemented correctly, all internal router links in one POP can be summarized at the POP 
level and injected into the core as a single route. But, all router loopback addresses within the 
POP are still propagated into the core as individual host routes, giving optimal routing to all 
loopback interfaces. 
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Scaling Service Provider 
Routing Protocols (Cont.) 


Scaling BGP 
° Policy scaling 


— The AS routing policy should be unitary and 
easy to maintain. 


— This is achieved by re-using the same 
configuration in all EBGP speaking routers. 


° IBGP mesh scaling 


— Avoid unnecessary duplicate updates over a 
physical link. 


¢ Updates and table size 
—Route summarization is the key to scalability. 


The task of scaling BGP actually involves three different and independent scaling tasks: 


= BGP policy scaling: The AS routing policy should be unitary and easy to maintain. 
Different edge routers of the same AS should not use different policies and thereby 
advertise different routes to neighboring autonomous systems. Regardless of which router 
is currently active, the same routing policy should be in place. Administratively, replication 
of the same routing policies requires the same configuration lines in several edge routers. 


= IBGP mesh scaling: All BGP-speaking routers must be updated with consistent IBGP 
information. In the traditional BGP approach, ensuring consistent routing information was 
achieved by establishing a full mesh of IBGP sessions between all routers within the AS. 
An IBGP full mesh is certainly not scalable, and several tools are now available to achieve 
the same results without the full mesh. 


m= Updates and table size: The number of routes in the routing table and the number of 
updates that are sent and received represent the third scaling task. Route summarization is 
the key to this scalability. 


Copyright © 2004, Cisco Systems, Inc. Scaling Service Provider Networks 6-15 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Scaling Service Provider Addressing 


This topic describes the scaling issues that are relevant to IP addressing in service provider 
networks. 


Scaling Service Provider Addressing 
es Se 2 LIRR | 


Private vs. Public Addresses 


¢ Private addresses on links break traceroute when 
run from inside a firewall. 


¢ Private addresses on loopbacks call for careful 


external routing. 


¢ MPLS with TTL propagation disabled solves the 
traceroute issue. 


¢ Otherwise, use public addresses in service 
provider networks. 
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Using private addresses in a service provider network has some drawbacks. Private addresses 
on the provider internal links will cause trouble for the traceroute application. When the 
traceroute command is executed from a router inside a customer network that resides inside a 
firewall, the Internet Control Message Protocol (ICMP) replies that are generated by the 
provider router will have the source IP address assigned using the outgoing interface. If this is a 
private address, the customer firewall will most likely filter the packet because of address- 
spoofing detection rules. Even if the packet were allowed to enter the customer network, 
Domain Name System (DNS) reverse lookups would either fail or result in confusing printouts. 


Using MPLS without Time to Live (TTL) propagation in the service provider network can 
easily overcome the traceroute problem with private addresses. If these functions are used, the 
provider network will appear as a single hop to the traceroute application. The intermediate 
routers will be invisible and thus can use private addresses. 


Using private addresses on the service provider router loopback interfaces is possible. 
However, you must take care not to advertise any private addresses to any other AS. 


A tule of safety is to prevent the announcement of any private addresses by using prefix-lists 
that are applied on outgoing updates to external neighbors. The same prefix-list mechanism can 
also be used on the provider edge routers to prevent accepting private addresses from any other 
AS if the other AS, by mistake, announces private addresses. 
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Example 


Scaling Service Provider 
Addressing (Cont.) 


¢ Assign addresses to allow for route summarization. 


Network Core 


Link address from range 210.1.1.0/24 Link address from range 210.1.2.0/24 
Loopbacks from range 173.16.1.16/28 Loopbacks from range 173.16.1.32/28 
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In the figure, the left POP has been allocated two different address spaces. The address space 
210.1.1.0/24 has been allocated to assign addresses to internal links within the POP. The 
address space 173.16.1.16/28 is used to assign addresses to loopback interfaces on routers 
within the POP. 


Likewise, the right POP has assigned 210.1.2.0/24 to internal links and 173.16.1.32/28 to be 
used with loopback interfaces. 


The two POPs connect to the core, and, as they do, both summarize the range for their internal 
links while they avoid summarizing the addresses that are assigned to the loopback interfaces 
of the POP routers. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
isc cor 


¢ The service provider network usually consists of a network 
core that interconnects edge devices that are located at 
various POPs. 


Service providers use an IGP to carry internal routes and to 
provide optimal routing between POPs, the information that 
is needed for IBGP sessions to be established, and the 


addresses that are required for BGP next-hop resolution. 


EBGP sessions are used to exchange information with other 
service providers and in some cases to connect customers 
as well. Customer routes and routes that are received from 
other service providers are carried in BGP. 


Using private addresses on the service provider router 
loopback interfaces is possible. But you must take care not 
to advertise any private addresses to any other autonomous 
system. 


References 


For additional information, refer to this resource: 


m= For more information on scaling IGP and BGP in service provider networks, refer to 
“Designing Large-Scale IP Internetworks” at the following URL: 
http://www.cisco.com/univercd/cc/td/doc/cisintwk/idg4/nd2003.htm 
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Introducing Route Reflectors 


Overview 


Two routers that have opened a BGP connection between themselves for the purpose of 
exchanging routing information are known as neighbors. Typically, routers within an AS are 
configured in a full mesh. Route reflectors are a BGP scalability mechanism that enables 
routing information to be redistributed to all routers within an AS while eliminating the need 
for a fully meshed topology within the AS. This feature reduces the number of TCP sessions 
that must be maintained, lowering network overhead and CPU and memory resource 
requirements. 


This lesson introduces BGP route reflectors by explaining why route reflectors improve BGP 
scalability. Modified split-horizon rules, when you are using route reflectors, are also 
discussed. The lesson concludes by describing the different redundancy mechanisms that are 
used with route reflectors, including route reflector clusters. 


Relevance 


Large BGP networks cannot properly scale without relying on performance-enhancing tools 
such as route reflectors and confederations. Route reflectors enable BGP routing information to 
be distributed in a fashion that does not require a physical fully meshed network. Network 
overhead is reduced by decreasing the number of TCP connections that are required to 
distribute routing information and by lessening router CPU and memory requirements. 


Objectives 


Upon completing this lesson, you will be able to describe the use of route reflectors in a BGP 
environment. This includes being able to meet these objectives: 


Explain the need for BGP route reflectors 

Explain how route reflectors modify traditional IBGP split-horizon rules 
Explain the benefits of deploying redundant route reflectors 

Describe the concept of route reflector clusters 


Describe additional route reflector mechanisms that have been designed to prevent routing 
loops 
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Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 

° Overview 

° IBGP Scalability Issues in a Transit AS 
¢ Route Reflector Split-Horizon Rules 

* Redundant Route Reflectors 

* Route Reflector Clusters 


* Additional Route Reflector Loop 
Prevention Mechanisms 


° Summary 
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IBGP Scalability Issues in a Transit AS 


This topic explains the need for BGP route reflectors by describing the scalability issues of 
BGP transit backbones. 


IBGP Scalability Issues in a Transit AS 


IBGP requires a full mesh between all BGP- 
speaking routers. 


¢ Large number of TCP sessions 

¢ Unnecessary duplicate routing traffic 
Solutions 

¢ Route reflectors modify IBGP split-horizon rules 


* BGP confederations modify IBGP AS-path 
processing 
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Classic IBGP split-horizon rules specify that updates that are received on an EBGP session 
should be forwarded on all IBGP and EBGP sessions, but updates that are received on an IBGP 
session should be forwarded only to all EBGP sessions. This rule requires a BGP boundary 
router to be able to send routing updates to all other BGP-speaking routers in its own AS 
directly through a separate IBGP session to each of them. 


The primary reason for the IBGP split-horizon rule is to avoid routing information loops within 
the AS. If the information that is received through an IBGP session is forwarded on other IBGP 
sessions, the information might come back to the originator, and be forwarded again in a never- 
ending loop. The originator would not detect the loop because no BGP attributes are changed 
on IBGP sessions. 


The general design rule in classic IBGP is to have a full mesh of IBGP sessions. But a full 
mesh of IBGP sessions between n number of routers would require (n * (n-1)) / 2 IBGP 
sessions. For example, a router with an AS that contains 10 routers would require (10 * (10 — 
1))/ 2 = 45 IBGP sessions. Imagine the number of sessions (and the associated router 
configuration) that would be required for a single AS containing 500 routers. 


Every IBGP session uses a single TCP session to another IBGP peer. An update that must be 
sent to all IBGP peers must be sent on each of the individual TCP sessions. If a router is 
attached to the rest of the network over just a single link, this single link has to carry all TCP/IP 
packets for all IBGP sessions. This requirement results in multiplication of the update over the 
single link. 
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Two different solutions are available to achieve greater scalability when you are faced with the 
full-mesh rules of IBGP autonomous systems: 


™ Route reflectors modify the classic IBGP split-horizon rules and allow a particular router to 
forward incoming IBGP updates to an outgoing IBGP session under certain conditions. 
This router becomes a concentration router, or a route reflector. 


= BGP confederations (covered in a separate lesson) introduce the concept of a number of 
smaller autonomous systems within the original AS. The small autonomous systems 
exchange BGP updates between them using intra-confederation EBGP sessions. 
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Route Reflector Split-Horizon Rules 


This topic explains how route reflectors modify traditional IBGP split-horizon rules. 


Route Reflector Split-Horizon Rules 


Route Reflector, 


———————|{§O } 
EBGP route 3 


002G_151 


¢ Classic IBGP: IBGP routes are ¢ Route reflector can propagate 
not propagated to other IBGP IBGP routes to other IBGP peers. 
pects: * Full mesh of IBGP peers is no 

¢ Full mesh of IBGP peers is longer required. 
therefore required. 


In classic IBGP, the BGP boundary router needs to forward the route that is received from an 
EBGP peer to each and every other router within its own AS using a dedicated IBGP session 
for each one. Also, the BGP boundary router forwards routes that are sourced by a router in the 
same way. To allow every router to update every other router, a full mesh of IBGP sessions is 
required. 


The IBGP route reflector design relaxes the need for a full mesh. The router, configured as a 
route reflector, under certain conditions, will relay updates that are received through an IBGP 
session to another IBGP session. This capability requires modifications of the classic IBGP 
split-horizon rules. 


The route reflector concept introduces processing overhead on the concentration router and, if it 
is configured incorrectly, can cause routing loops and instability. 
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Route Reflector 
Split-Horizon Rules (Cont.) 


Autonomous Sys 


EBGP peer 


When you implement a route-reflector-based IBGP network, the BGP routers are divided into 
route reflectors (which implement modified split-horizon rules) and clients (which are behaving 
like traditional IBGP routers). 


Route reflector clients are excluded from the full mesh. They can have any number of EBGP 
sessions but may have only one IBGP session, the session with their route reflector. Clients 
conform to the classic IBGP split-horizon rules and forward a received route from EBGP on 
their IBGP neighbor sessions. But the route reflector conforms to the route reflector split- 
horizon rules and recognizes that it has an IBGP session to a client. When the IBGP update is 
received from the client, the route reflector forwards the update to other IBGP neighbors, 
therefore alleviating the IBGP full-mesh requirement for its clients. 


Similarly, when the route reflector receives an IBGP update from a neighbor that is not its 
client, it will forward the update to all of its clients. 


Forwarding of an IBGP update in a route reflector does not change the next-hop attribute or any 
other common BGP attribute. This feature means that the client will use the most optimum 
route by means of recursive routing, regardless of the way that it has received the BGP route. 
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Route Reflector 
Split-Horizon Rules (Cont.) 


The table presents detailed IBGP split-horizon rules as modified by the introduction of BGP 
route reflectors. For purposes of definition, a “route reflector” is a BGP speaker that can 


Client 


Routes received from non-client 
IBGP neighbors are sent to clients 
and EBGP peers 


Autonomous System 


Reflector 


Reflector ————> Reflector 


Client 


All IBGP and EBGP routes 
are sent to EBGP peers 


H 


002G_157 


advertise IBGP learned routers to another IBGP peer and, hence, can reflect routes. IBGP peers 
of the route reflector fall under two categories: “clients” and “nonclients.” The route reflector 


and its clients form a “cluster.” All IBGP peers of the route reflector that are not part of the 


cluster are nonclients. A “classic” IBGP router is a router that does not support route reflector 


functionality. 
Type of Router Incoming Update Is Forwarded To 
From 
Classic EBGP peer All peers (IBGP and EBGP) 
IBGP peer EBGP peers 
Route reflector EBGP peer All peers (IBGP and EBGP) 


Nonclient IBGP peer 
Client IBGP peer 


EBGP peers and clients 


All peers but the sender 


Client 


EBGP peer 


All peers (IBGP and EBGP) 


IBGP peer 


EBGP peers 
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Redundant Route Reflectors 


This topic explains the benefits of deploying redundant route reflectors. 


Redundant Route Reflectors 


Autonomous System 


> 


Reflector Reflector EBGP peer 


But the reflector 
could be a single 
point of failure 


EBGP peer 


(002G_377 


Design Requirement: Route reflectors must be redundant. 


BGP v3.1—6-7 


Clients may have any number of EBGP peers but may have IBGP sessions only with their route 
reflector(s). If the reflector fails, its client can no longer send BGP updates to, or receive them 
from, the rest of the AS. The route reflector is, therefore, a single point of failure. 


To avoid introducing a single point of failure into the network, the route reflector functionality 
must be as redundant as the physical network. If a client will still be physically attached to the 
network after its route reflector has failed, the client should have a redundant route reflector. 
Thus, in all highly available networks, route reflectors must be redundant. 
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Redundant Route Reflectors (Cont.) 


Redundant reflectors solve 
high-availability requirement 
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The concept of “clusters” is introduced to prevent IBGP 
routing loops between route reflectors. 


A client may have IBGP sessions to more than one route reflector to avoid a single point of 


failure. Each client will receive the same route from both of its reflectors. Both route reflectors 
will receive the same IBGP update from their client, and they will both reflect the update to the 


rest of the clients. Additionally, both route reflectors will get updated from the full mesh and 
reflect those updates to their clients. As a result, each client will get two copies of all routes. 


Under certain circumstances (particularly when you use weights on IBGP sessions to influence 


BGP route selection), improper route reflection can result in an IBGP routing loop that is 
impossible to detect. Additional BGP attributes are thus necessary to prevent these routing 


loops. 
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6-27 


Route Reflector Clusters 


This topic describes the concept of route reflector clusters and their loop prevention benefits 
when you are deploying route reflectors in redundant configurations. 


Route Reflector Clusters 


° A group of redundant route reflectors and their 
clients form a cluster. 


* Each cluster must have a unique cluster-ID. 


¢ Each time a route is reflected, the cluster-ID is 
added to the cluster-list BGP attribute. 


¢ The route that already contains the local 
cluster-ID in the cluster-list is not reflected. 


A router that is acting as a route reflector client does not require any specific configuration. It 
simply has fewer IBGP sessions than it would have if it were part of the full mesh. But 
improperly configuring the client to also be a reflector could easily cause a loop. An IBGP 
route coming in from one of the real reflectors to the client could be forwarded by the client, 
erroneously acting as reflector, to the other reflector. 


Route reflector clusters prevent IBGP routing loops in redundant route reflector designs. 


The role of the network designer is to properly identify which route reflectors and their clients 
will form a cluster. The designer assigns to the cluster a cluster-ID number that is unique within 
the AS. 


Note The cluster-ID number must be configured in the route reflectors. The clients should not be 
configured with this information. 


A route reflector router can reflect routes only within a single cluster. A route reflector can, 
however, participate in another cluster but only as a client. A client can function as a client only 
to a route reflector belonging to the same cluster. 
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When a route is reflected, the reflector creates the cluster-list attribute and attaches it to the 
route if it does not already exist. It then sets its cluster-ID number in the cluster-list or adds its 
cluster-ID number to an already existing cluster-list attribute. If the route, for any reason, is 
ever reflected back to the same reflector, it will recognize its cluster-ID number in the cluster- 
list and not forward it again. The first route reflector that reflects the route also sets an 
additional BGP attribute, called “originator-ID,” and adds it to the BGP router-ID of its client. 


Note The cluster-list and originator-ID attributes are nontransitive optional BGP attributes, 
allowing routers that do not support route reflector functionality to coexist with route 
reflectors and their clients in the same AS. 


Based on cluster-list and originator-ID attributes, routers can implement two loop prevention 
mechanisms: 


m Any router that receives an IBGP update with the originator-ID attribute set to its own BGP 
router-ID will ignore that update. 


m Any route reflector that receives an IBGP update with its cluster-ID already in the cluster- 
list will ignore that update. 
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Example 
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In a cluster with redundant route reflectors, the client will forward the received EBGP update to 
both reflectors. The route reflectors forward the update into the IBGP full mesh. This behavior 
means that they will send the update to each other as well. But when a route reflector receives a 
BGP update from another route reflector, it will recognize their common cluster-ID number in 
the cluster-list attribute. Therefore, the newly received route update is ignored. 
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Additional Route Reflector Loop Prevention 
Mechanisms 


This topic describes additional route reflector mechanisms designed to prevent routing loops. 


Additional Route Reflector 
Loop Prevention Mechanisms 


° Every time a route is reflected, the router-ID of 
the originating IBGP router is stored in the 
originator-ID BGP attribute. 


° Arouter receiving an IBGP route with 
originator-ID set to its own router-ID ignores 
that route. 


° BGP path selection procedure is modified to 
take into account cluster-list and originator-ID. 


When a route is reflected, the route reflector will set the originator-ID BGP attribute 
(nontransitive optional BGP attribute) to the router-ID of the peer from which it received the 
route. Any router that receives a route with its own router-ID in the originator-ID attribute 
silently ignores that route. 


BGP path selection rules have been modified to select the best route in scenarios where a router 
might receive reflected and nonreflected routes or several reflected routes: 


m= The traditional BGP path selection parameters (weight, local preference, origin, MED) are 
compared first. 


m If these parameters are equal, the routes that are received from EBGP neighbors are 
preferred over routes that are received from IBGP neighbors. 


m When a router receives two IBGP routes, the nonreflected routes (routes with no 
originator-ID attribute) are preferred over reflected routes. 


m The reflected routes with shorter cluster-lists are preferred over routes with longer 
cluster-lists. 


m If the additional route-reflector-oriented selection criteria do not yield a decision, the rest of 
the traditional BGP path selection rules are followed. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
isc cor 


¢ BGP route reflectors were introduced to free the network 
designers from IBGP full-mesh requirements that prevent 
large networks from scaling. 


BGP route reflectors modify IBGP split-horizon rules in that 
all routes that are received from a route reflector client are 
sent to all other IBGP neighbors and all routes that are 


received from a nonclient IBGP neighbor are sent to all 
route reflector clients. 


A route reflector is a single point of failure, and therefore 
redundancy should be implemented in a network 
containing route reflectors. 


Route reflector clusters were introduced in the BGP route 
reflector architecture to support redundancy. 


The originator-ID and cluster-list BGP attributes were 
introduced to prevent routing loops in route reflector 
environments. 


References 


For additional information, refer to this resource: 


m= For more information on route reflectors, refer to “BGP Case Studies 4” at the following 
URL: http://www.cisco.com/warp/public/459/bgp-toc.html#routereflectors 


Next Steps 
For the associated lab exercise, refer to the following section of the course Lab Guide: 


m Lab Exercise 6-1: Introducing Route Reflectors 
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Designing Networks with 
Route Reflectors 


Overview 


Route reflectors are a BGP scalability mechanism that enables routing information to be 
redistributed to all routers within an AS while eliminating the need for a fully meshed topology 


within the AS. Properly implementing these features requires careful network design within the 
AS. 


This lesson introduces the network design rules that network designers should follow when 
implementing a network with BGP route reflectors. It also lists the potential issues that can 
arise if the network design rules are not adhered to. The lesson concludes by describing the 
concept of hierarchical route reflectors. 


Relevance 


Large BGP networks cannot properly scale without relying on performance-enhancing tools 
such as route reflectors and confederations. Route reflectors enable BGP routing information to 
be distributed in a fashion that does not require a physical full-mesh network. Implementing 
such a network requires careful design, or routing issues such as lost routes or loops can occur. 


Objectives 


Upon completing this lesson, you will be able to describe the requirements of route reflectors. 
This includes being able to meet these objectives: 


m List the network design rules for implementing BGP route reflectors 


m List the potential issues that can arise if you do not follow the route reflector network 
design rules 


m Explain the purpose and function of hierarchical route reflectors 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m™ Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 
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Outline 


The outline lists the topics included in this lesson. 


Outline 
EE EO Cisco.com 


° Overview 


* Network Design with Route Reflectors 


¢ Potential Network Issues 
¢ Hierarchical Route Reflectors 
° Summary 


BGP v3.1—6-2 


6-34 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Network Design with Route Reflectors 


This topic lists the network design rules for implementing BGP route reflectors. Included in this 
topic are the design rules for route reflectors and IBGP sessions. 


Network Design with Route Reflectors 
i a ed 


Route Reflector Rules 


¢ Divide transit AS into smaller areas (called 
clusters). 


¢ Each cluster contains route reflectors and route 
reflector clients. 


* Routers that do not support route reflector 
functionality act as a one-router cluster or asa 
route reflector client. 


BGP v3.1—6-3 


The physical topology of the network could serve as a guide to route reflector design. 


Implementing route reflectors within the transit AS will create smaller areas (or groups) of 
routers. These smaller groupings of routers are called clusters. A cluster consists of route 
reflector routers, either redundant or nonredundant, and the client routers that are connected to 
them. 


In designing the implementation of route reflectors within a transit AS, identify a group of 
peripheral routers that are physically connected to the same backbone router or routers. 
Consider the peripheral routers as clients and the backbone routers as route reflectors. Then, 
consider this group of routers together to form a cluster. 


Note Additional design examples and rules are available in the module “BGP Transit Autonomous 
Systems.” 


Only the routers that are configured as route reflectors require a Cisco IOS software version 
with route reflector functionality. A router lacking this functionality in its installed Cisco IOS 
software can function as a client or be a part of the full mesh. Normally, this situation is not a 
concern because route reflector functionality has been incorporated in IOS software since 
Release 11.1. 
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6-36 


Network Design with Route 
Reflectors (Cont.) 


IBGP Session Rules 


° All clients in a cluster must establish IBGP 
sessions with and only with all route reflectors in 
the cluster. 


¢ IBGP full mesh between all route reflectors within 
the AS is required. 


¢ Routers that are not route reflectors can 
participate in IBGP full mesh or be route reflector 
clients. 


The principal goal for designing networks with BGP route reflectors is to reduce the size of the 
full mesh of IBGP sessions by excluding some routers from the mesh. The routers that are 
excluded from the full mesh, the clients, have to send their IBGP information to, and receive it 
from, at least one router that belongs to the full mesh, the route reflector. Thus, the full mesh is 
still there, but it is smaller, and all route reflectors have to be part of it. 


All clients in a cluster should have IBGP sessions with all their route reflectors and their route 
reflectors only. If a client does not have sessions with all the reflectors in the cluster, the 
redundancy is violated. If a client has IBGP sessions to routers other than the route reflectors, 
unnecessary routing traffic will be generated. 


Both clients and other routers, those that are not route reflectors, obey the classic IBGP split- 
horizon rules. Thus, non-route-reflector routers are either a client to a reflector or are 
participating directly in the full mesh. 
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Example 


Network Design with Route 
Reflectors (Cont.) 
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In this example, the routers that serve as route reflectors and the non-route-reflector router have 
IBGP sessions in a full mesh. 


In the area called the “redundant cluster,” the four client routers and the two route reflector 
routers make up the cluster. Each of the four client routers has an IBGP session with the two 
route reflectors and only with those two route reflectors. 


In the nonredundant area, each of the two client routers has a single physical connection to a 
route reflector router. These three routers form a nonredundant cluster. The router designated as 
the route reflector in the cluster is already a single point of failure in this physical design 
because a failure of this router will prevent the clients in the cluster from reaching the rest of 
the network. Therefore, there is no new single point of failure that is introduced when the router 
is configured as the only route reflector in this cluster. Each of the two clients has a single 
IBGP session to the route reflector. 


The other router shown is not configured as a route reflector nor is it a client to any other route 
reflector. It serves as an example of where a non-route-reflector router participates in the full 
mesh. 
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Potential Network Issues 


This topic lists the potential issues that can arise if the route reflector network design rules as 
explained in the previous topic are not followed. 


Potential Network Issues 
in CISeOrcom mess | 


Potential problems that can occur when you deviate 
from the route reflector network design rules: 


Issue Result 


Clients do not have sessions ¢ Clients will not receive all 
with all reflectors in a cluster IBGP routes 


Clients have sessions with * Clients will receive duplicate 
reflectors in several clusters copies of the same route 


Clients have IBGP sessions ° Clients will receive duplicate 
with other clients copies of the same route 


BGP v3.1—6-6 


Two nontransitive optional BGP attributes, originator-ID and cluster-list, are both used to 
prevent fatal loops of information. The use of these two attributes makes a network fairly 
insensitive to poor configuration. However, for optimal performance, you must have an optimal 
configuration. Here are some of the problems that could occur if you deviate from route 
reflector network design rules: 


m If route reflectors are not connected with IBGP sessions in a full mesh, some clusters will 
not have all the routes. 


m Ifaclient has IBGP sessions with some route reflectors in a cluster, but not all of them, the 
client might miss some BGP routes. 


m Ifaclient has IBGP sessions to route reflectors that belong to different clusters, the BGP 
update from the client will be forwarded by the client into the full mesh with different 
cluster-IDs in the cluster-list attribute. When the BGP update enters the mesh, it will reach 
the other route reflector, which will, unnecessarily, accept the route as valid and forward it 
into its cluster. This situation, in turn, causes unnecessary duplication of updates to the 
clients. 


m Ifaclient has IBGP sessions to other clients in the same cluster, those clients will receive 
unnecessary duplications of updates. 
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Hierarchical Route Reflectors 


This topic explains the purpose and function of hierarchical route reflectors. 


Hierarchical Route Reflectors 


Problem: 


° In very large networks, a single layer of route 
reflectors might not be enough. 


Solution: 


° A hierarchy of route reflectors can be established. 


—A route reflector can be a client of another route 
reflector. 


— The hierarchy can be as deep as needed. 


Network designers can build route reflector clusters in hierarchies. With hierarchies, a router 
serving as a route reflector in one cluster can act as a client in another cluster. 


Clients are not configured to be route reflector clients; they simply have fewer IBGP sessions. 
On the contrary, a network designer must configure a route reflector. In configuring an IBGP 
session on a route reflector, the designer must configure the session to reach a client in order 
for the route reflector IBGP split-horizon rules to start working. All other IBGP sessions that 
are configured on the route reflector are a part of the full mesh. Also, the designer must 
configure the cluster-ID on the route reflector. 


A router that is configured to be a route reflector will still have ordinary IBGP sessions that are 
part of the full mesh. If these sessions are reduced in number and only a few remain, and the 
remaining ones reach a second level of route reflectors, a hierarchy of route reflectors is 
created. 


When a designer builds a first level of clusters, the remaining full mesh is smaller than when all 
routers belonged to it. But if it is large enough, the designer can build an additional level of 
route reflectors. 
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In this example, the first level of route reflector clusters was built by creating cluster 11 and 
cluster 12. This first step reduced the original full mesh of 14 routers to a full mesh of 8 routers. 


A second level of route reflector clusters was built by creating cluster 27. This second step 
further reduced the full mesh of eight routers to a full mesh consisting of only two routers. Only 
the two route reflectors in cluster 27 should be connected in a full mesh. 


When a client in the lowest level receives an EBGP update, it will forward it on all configured 
IBGP sessions to a route reflector. The route reflector recognizes BGP updates that are received 
from configured clients and will forward these updates to all other clients that use normal IBGP 
sessions. The update, sent on a normal IBGP session, will be a second-level client update to the 
second-level route reflector. The second-level route reflector will recognize that the update was 
received from a client and will forward it to all other clients and into the full mesh. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
isc cr 


¢ All route reflectors in a cluster should have IBGP 
sessions to all clients in the cluster. The route 
reflectors also participate in the IBGP full mesh, and 
they should have no other IBGP sessions. 


When the route reflector clients do not have IBGP 


sessions with all route reflectors in the cluster, they 
might not receive all IBGP routes. 


¢ When the clients have additional IBGP sessions with 
routers that are not their route reflectors, they will 
receive unnecessary IBGP routes and potentially 
encounter a routing loop. 


Route reflector clusters can be built in hierarchies. A 
router that is a route reflector in one cluster can act 
as client in another cluster. 


References 


For additional information, refer to this resource: 


m= For more information on route reflectors, refer to “BGP Case Studies 4” at the following 
URL: http://www.cisco.com/warp/public/459/bgp-toc.html#routereflectors 
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Configuring and Monitoring 
Route Reflectors 


Overview 


This lesson introduces the steps that are required to successfully migrate an existing AS to BGP 
route reflectors. It also lists the Cisco IOS commands that are required to configure and monitor 
route reflectors. 


Relevance 


Large BGP networks cannot properly scale without relying on performance-enhancing tools 
such as route reflectors and confederations. Route reflectors enable BGP routing information to 
be distributed in a fashion that does not require a physical full-mesh network. Implementing 
such a network requires knowledge of the steps to properly migrate and configure route 
reflectors, and the commands that are used to verify the operation of a configured network. 


Objectives 


Upon completing this lesson, you will be able to describe the configuring and monitoring of 
route reflectors. This includes being able to meet these objectives: 


m List the steps to migrate an existing IBGP backbone to a backbone with route reflectors 


m= Identify the Cisco IOS commands that are required to configure route reflectors on a BGP 
backbone 


m= Identify the Cisco IOS commands that are required to monitor a BGP backbone that 
contains route reflectors 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m™ Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 
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Outline 


The outline lists the topics included in this lesson. 


Outline 
OE EO Cisco.com 


° Overview 
* Route Reflector Backbone Migration 
¢ Configuring Route Reflectors 


* Monitoring Route Reflectors 


° Summary 


BGP v3.1—6-2 


6-44 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Route Reflector Backbone Migration 


This topic lists the steps that are required to successfully migrate an existing IBGP backbone to 
a backbone with route reflectors. 


Route Reflector Backbone Migration 


¢ Divide the autonomous system into areas 
(clusters). 
— Assign a cluster-ID to each area. 


° On route reflector clients, retain only IBGP 
sessions with route reflectors in their cluster. 


¢ On route reflectors, retain only IBGP sessions 
with other route reflectors and clients in their 
cluster. 
— Configure cluster-ID on every route reflector. 
— Configure clients on every route reflector. 


BGP v3.1—6-3 


The physical topology of the AS serves as a guide to designing clusters. You should introduce 
no additional single points of failure when you are deploying route reflectors. If the physical 
topology is redundant, a good practice is to have redundant route reflectors. If the physical 
topology is not redundant, introducing a nonredundant cluster does not add a single point of 
failure because the network was already nonredundant. 


The following planning and preparation steps are required before you migrate from a full mesh 
of IBGP sessions to a route reflector design: 


Step 1 Identify a group of peripheral routers that are physically connected to the same set of 
backbone routers. Consider the peripheral routers as clients and the backbone routers 
as route reflectors. Let the routers form a cluster. Make sure that no router belongs to 
two different clusters, because this would represent an illegal configuration. 


Step 2 Create a numbering plan that indicates how numbers are assigned to the clusters in 
the network. The plan must make sure to uniquely identify each of the clusters 
within the AS. Clusters are not seen from outside the AS, so the plan does not need 
to be coordinated with any other AS. To ease troubleshooting, it is recommended 
that numbers lower than 256 be used, because cluster-IDs are displayed in IP 
address format. 


Note The default value of a cluster-ID is the BGP router-ID of the route reflector. If you decide to 
implement nonredundant clusters, you do not have to plan the cluster-ID numbers, because 
the BGP router-IDs should be unique. 
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Configuring Route Reflectors 


This topic lists the steps and the Cisco IOS commands that are required to configure BGP route 
reflectors. 


Configuring Route Reflectors 


¢ Configure cluster-ID on route reflectors. 


¢ Configure BGP neighbors as route reflector 
clients on the route reflectors. 


* No configuration is needed on the route 
reflector clients. 


¢ Make sure IBGP neighbor is removed on both 
ends of the IBGP session. 


As part of the planning and preparation that is necessary to migrate from a full mesh of IBGP 
sessions to a route reflector design, you need to make the following configuration changes: 


™ Configure the proper cluster-ID value on the route reflectors. 


= Configure the route reflector with information about which IBGP neighbor sessions are 
reaching their clients. 


m Inthe clients, remove all IBGP sessions to neighbors that are not a route reflector in the 
client cluster. 


m Make sure that the IBGP neighbor is removed on both ends of the IBGP session. 
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Configuring Route Reflectors (Cont.) 


router (config-router) # 


bgp cluster-id cluster-id 


* Optionally assigns a cluster-ID to the route reflector 
(default value is router-ID). 


¢ Required only for clusters with redundant reflectors. 


* Cluster-ID cannot be changed after the first client is 
configured. 


router (config-router) # 


neighbor ip-address route-reflector-client 


* Configures an IBGP neighbor to be a client of this 
reflector. 
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bgp cluster-id 


Command used to configure the cluster-ID if the BGP cluster has redundant route reflectors. 


m= bgp cluster-id cluster-id 


To remove the cluster-ID, use the no form of this command. 


= no bgp cluster-id cluster-id 


Syntax Description 


Parameter Description 


Cluster-ID of this router acting as a route reflector; the cluster-ID 
is a maximum of 4 bytes. 


cluster-id 
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neighbor route-reflector-client 


Command used to configure the router as a BGP route reflector and configure the specified 
neighbor as its client. When all the clients are disabled, the local router is no longer a route 
reflector. 


m= neighbor ip-address route-reflector-client 


To indicate that the neighbor is not a client, use the no form of this command. 


= no neighbor ip-address route-reflector-client 


Syntax Description 


Parameter Description 


ip-address Neighbor IP address 


By default, there is no route reflector in the AS. 


Example 


Configuring Route Reflectors ont) 


Cluster 175 router bgp 123 


=, aways S ! cluster ID 
wen wen bgp cluster-id 175 
! RR clients 
neighbor 1.0. 
neighbor 1.0. 


0.3 remote-as 123 

QO. 
neighbor 1.0.0. 

0. 

n 


3 
3 route-reflector-client 
4 remote-as 123 

neighbor 1.0.0.4 route-reflector-client 
! other IBGP neighbors 

1.0.0.3 1.0.0.4 neighbor 1.0.0.2 remote-as 123 

client client neighbor 1.2.0.6 remote-as 123 

! EBGP neighbors 

neighbor 2.7.1.1 remote-as 222 
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In this example, AS 123 has been divided into clusters with route reflectors. The routers with 
router-ID 1.0.0.1 and 1.0.0.2 are route reflectors in a cluster that has been assigned cluster-ID 
175. The routers with router-ID 1.0.0.3 and 1.0.0.4 are clients to these two route reflectors. 


The figure shows a portion of the configuration in router 1.0.0.1. The cluster-ID is assigned to 
the router under the router bgp process definition of the router configuration. After the router 
has been assigned, the route reflector client configuration is added under the router bgp 
process for the two neighbors that identify the two sessions reaching clients. 
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Monitoring Route Reflectors 


This topic lists the Cisco IOS commands that are required to monitor route reflector 
configurations. 


Monitoring Route Reflectors 


router# 


show ip bgp neighbors 


¢ Displays whether a neighbor is a route reflector client 


router# 


show ip bgp network [mask] 


* Displays additional path attributes (originator-ID and 
cluster-list) 
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show ip bgp neighbors 
To display information about the TCP and BGP connections to neighbors, use the show ip bgp 
neighbors EXEC command. 


m= show ip bgp neighbors [address] [received-routes | routes | advertised-routes | {paths 
regular-expression} | dampened-routes] 


In this case, the show ip bgp neighbors command is used on the router, not to see routes or 
paths that have been received but to see the status of the neighbor session, so no other qualifiers 
than the optional IP address are given. 


show ip bgp 
To display entries in the BGP routing table, use the show ip bgp EXEC command. 


m= ~=show ip bgp [network] [network-mask] [longer-prefixes] 


When details are displayed for a specific route entry in the BGP table, the cluster-list and 
originator-ID attributes are also shown. 
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Monitoring Route Reflectors (Cont.) 


router# show ip bgp neighbors 1.0.0.1 
BGP neighbor is 1.0.0.1, remote AS 213, internal link 
Index 1, Offset 0, Mask 0x2 
Route-Reflector Client 
BGP version 4, remote router ID 11.0.0.1 
BGP state = Established, table version = 5, up for 01:33:24 
Last read 00:00:24, hold time is 180, keepalive interval is 
60 seconds 
Minimum time between advertisement runs is 5 seconds 
Received 257 messages, 0 notifications, 0 in queue 
Sent 264 messages, 0 notifications, 0 in queue 
Connections established 5; dropped 4 
Last reset 01:33:33, due to : User reset request 
No. of prefix received 1 


002G_168 
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The show ip bgp neighbors command, issued on the route reflector router, indicates that the 
neighbor is a route reflector client. 


Monitoring Route Reflectors (ont) 


rtr-a# show ip bgp 11.0.0.0 
BGP routing table entry for 11.0.0.0/8, version 3 
Paths: (1 available, best #1, advertised over IBGP) 
Local, (Received from a RR-client) 
1.0.0.1 (metric 40640000) from 1.0.0.1 (11.0.0.1) 
Origin IGP, metric 0, localpref 100, valid, internal, best 


Routes received from the client as seen on the reflector 


rtr-b# sh ip bgp 14.0.0.0 
BGP routing table entry for 14.0.0.0/8, version 30 
Paths: (1 available, best #1) 
Not advertised to any peer 
Local 
1.0.0.3 (metric 41152000) from 1.0.0.2 (14.1.2.3) 
Origin IGP, metric 0, localpref 100, valid, internal, best 
Originator: 14.1.2.3, Cluster list: 0.0.2.55 


Reflected routes as seen on the client 
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The first example of a show ip bgp command is issued on a route reflector router. It shows that 
this particular entry in the BGP table was received from a route reflector client. 


The second example shows an entry in the BGP table that at some point was reflected from a 
route reflector. The reflecting router has added the originator-ID and cluster-list attributes to the 
route. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
ee 


* The deployment of BGP route reflectors entails 
only incremental configuration changes to the 
internal BGP setup and is easy to perform. You 
should follow the route reflector network design 
rules and migration plan when implementing 


BGP route reflectors. 


There are only two Cisco l|OS commands that are 
used to configure route reflectors: bgp cluster-id 
and neighbor /p-address route-reflector-client. 


The show ip bgp neighbors command will be 
displayed if a neighbor is a route reflector client, 
and the show ip bgp prefix command will display 
the originator-ID and cluster-list attributes. 


References 


For additional information, refer to these resources: 


m= For more information on route reflectors, refer to “BGP Case Studies 4” at the following 
URL: http://www.cisco.com/warp/public/459/bgp-toc.html#routereflectors 


m= For more information on configuring route reflectors, refer to “Configuring BGP” at the 


following URL: 
http://www.cisco.com/univercd/cc/td/doc/product/software/ios122/122cgcr/fipr_c/ipcprt2/1 
cfbgp.htm#xtocid45 
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Introducing Confederations 


Overview 


Routers within an AS are typically configured in a full mesh. Confederations and route 
reflectors are BGP scalability mechanisms that enable routing information to be redistributed to 
all routers within an AS while eliminating the need for a fully meshed topology within the AS. 
These features reduce the number of TCP sessions that must be maintained, which lowers 
network overhead, and CPU and memory requirements. Confederations can serve as an 
alternative or a complement to route reflectors. The confederation feature enables network 
administrators to break up an AS into a set of logical subautonomous systems. 


This lesson introduces BGP confederations by explaining why confederations are used to 
improve BGP scalability. This lesson also discusses AS-path propagation and processing in an 
AS that contains confederations. 


Relevance 


Large BGP networks cannot properly scale without relying on performance-enhancing tools 
such as route reflectors and confederations. Confederations enable BGP routing information to 
be distributed in a fashion that does not require a physical full-mesh network. Network 
overhead is reduced by decreasing the number of TCP connections that are required to 
distribute routing information and thus lessening router CPU and memory resource 
requirements. 


Objectives 


Upon completing this lesson, you will be able to describe the use of BGP confederations. This 
includes being able to meet these objectives: 


m Explain the need for BGP confederations 

m Explain the concept of AS splitting with BGP confederations 

m Describe AS-path propagation in BGP confederations 

m Explain AS-path attribute processing in an AS that contains BGP confederations 


m Explain the properties of intra-confederation EBGP sessions 
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Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
—— ee CICOYCO 1 | 


° Overview 
° IBGP Transit AS Problems 


¢ Splitting a Transit AS with BGP 
Confederations 


° AS-Path Propagation Within the BGP 
Confederation 


¢ AS-Path Processing in BGP Confederations 
° Intra-Confederation EBGP Session Properties 
° Summary 
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IBGP Transit AS Problems 


This topic describes the IBGP full-mesh requirement when you are using a transit AS, and the 
potential issues that this requirement can cause. Solutions to the IBGP full-mesh requirement 
are also discussed. 


IBGP Transit AS Problems 


IBGP requires a full mesh between all BGP- 
speaking routers 


¢ Large number of TCP sessions 
¢ Unnecessary duplicate routing traffic 


Solutions 


¢ Route reflectors modify IBGP split-horizon rules 


* BGP confederations modify IBGP AS-path 
processing 


Classic IBGP split-horizon rules specify that BGP updates that are received on an EBGP 
session should be forwarded on all IBGP and EBGP sessions, but BGP updates that are 
received on an IBGP session should be forwarded on all EBGP sessions only. This rule requires 
a boundary router to be able to update all other BGP-speaking routers in its own AS directly via 
an IBGP session that is established to each of them. 


IBGP split-horizon rules avoid routing information loops within the AS. If IBGP information 
was forwarded to another IBGP peer router, the information might come back to the originator, 
and be forwarded again in a never-ending loop. The originator would not detect the loop 
because no BGP attributes are changed when an update is sent through an IBGP session. 


The general design rule in classic IBGP is to have a full mesh of IBGP sessions between all 
BGP-speaking routers inside an AS. However, a full mesh of IBGP sessions between n number 
of routers would require (n * (n-1)) / 2 IBGP sessions. For example, an AS with 10 routers 
would require (10 * (10 — 1)) / 2 = 45 IBGP sessions. 


Every BGP session between two routers is established through a separate TCP session to the 
BGP peer. An update that must be sent to all IBGP peers must be sent separately on each of the 
TCP sessions. If a router is attached to the rest of the network over just a single link, this single 
link has to carry all TCP/IP packets for all IBGP sessions. This requirement results in 
duplication of BGP updates over the single link. 
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Two different solutions are available to achieve greater scalability when you are faced with the 
full-mesh rules of IBGP autonomous systems: 


= Route reflectors: Route reflectors modify the classic IBGP split-horizon rules and allow a 
particular router to forward incoming IBGP updates to an outgoing IBGP session under 
certain conditions. This router becomes a concentration router, or a route reflector. 


= BGP confederations: BGP confederations introduce the concept of a number of smaller 
autonomous systems within the original AS. The small autonomous systems exchange BGP 
updates between them using intra-confederation EBGP sessions. 


Example 


A large service provider backbone, acting as a transit AS, contains 150 routers. Because the 
classic IBGP design rule requires a full mesh, the AS would require 11,175 sessions 

(n * [n-1] / 2). This number is impractical, and therefore you should use other solutions, such as 
BGP confederations, to reduce the full-mesh requirements of the network. 
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Splitting a Transit AS with BGP Confederations 


This topic describes how you can use BGP confederations to split an AS into a series of smaller 
autonomous systems. 


Splitting a Transit AS with 
BGP Confederations 


real EBGP 
session 


IBGP session 


Splitting the AS into smaller autonomous systems would reduce the 
number of BGP sessions, but extra AS numbers are not available. 


Confederations enable internal AS numbers to be hidden and 
announce only one (external) AS number to EBGP neighbors. 
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A large number of routers in a large transit AS would traditionally introduce a complex full- 
mesh structure of IBGP sessions. By splitting the AS into a number of small autonomous 
systems, you can provide each one of the small systems with a fairly simple IBGP structure. 
Interconnections between these autonomous systems could then be made using EBGP, which 
allows for arbitrary topologies. 


Splitting an AS into smaller autonomous systems requires a large number of official AS 
numbers, which are a scarce resource. 


However, by introducing the BGP confederation, you can enable a large AS to be partitioned 
into a number of smaller autonomous systems (called “member autonomous systems”) where 
each is internal to the larger AS. The AS numbers of each member-AS that is used within the 
confederation are never visible from outside the confederation itself. This invisibility allows 
private AS numbers (in the range 64512-65535) to be assigned to autonomous systems inside a 
confederation to identify a member-AS, without the need to coordinate AS number assignments 
with an official AS delegation authority. 


Within a member-AS, the classic IBGP rules apply. Therefore, all BGP routers inside the 
member-AS must still maintain a full mesh of BGP sessions. 


Between member autonomous systems inside a confederation, EBGP sessions are established. 
These EBGP sessions behave slightly differently from classic EBGP sessions and are therefore 
named intra-confederation EBGP sessions to differentiate them from true EBGP sessions. 
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AS-Path Propagation Within the BGP 
Confederation 


This topic describes how the AS-path attribute is propagated inside and outside of the BGP 
confederation. 


AS-Path Propagation Within the 
BGP Confederation 


nn Cisco'co ma 
IBGP session 
* AS path is not changed. 
Intra-confederation EBGP session 


¢ Intra-confederation AS number is prepended to AS 
path. 


EBGP session with external peer 


e Intra-confederation AS numbers are removed from 
the AS path. 


¢ External AS number is prepended to the AS path. 
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The mandatory well-known BGP attribute AS-path is modified on EBGP and intra- 
confederation EBGP sessions. The sender prepends its own AS number to the AS path 
whenever an EBGP update is sent. When a BGP update traverses the Internet, each and every 
AS it passes through will be recorded in the AS path. If the update, for any reason, comes back 
to an AS in which it has already been, the receiving router will recognize its own AS in the AS 
path and silently ignore the update. This mechanism prevents information loops and allows 
arbitrary topology when you are interconnecting autonomous systems. 


IBGP sessions do not modify the AS-path attribute, so the topology within each AS is limited 
to the full mesh, and the propagation of BGP updates across multiple IBGP sessions is 
prohibited. 


When a router sends a BGP update over an intra-confederation EBGP session, it prepends the 
member-AS number to the AS path. This information is maintained by the routers within the 
confederation and prevents routing information loops inside the confederation. 


When a router sends a BGP update over a true EBGP session to an AS outside of the 
confederation, it removes the part of the AS path describing the member-AS numbers and 
prepends the official AS number to the AS path. As a result, the confederation appears as one 
single AS to the outside world. 
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Example 


AS-Path Propagation Within the 
BGP Confederation (Cont.) 


8 
=i 
Q 
g§ 
s$ 
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The figure illustrates how the AS-path attribute is processed within a BGP confederation. 


Network X originates inside AS 12 and is announced by the edge router in AS 12 over a true 
EBGP session to the ingress router in the confederation. The edge router in AS 12 determines 
that the edge router that it is communicating with resides in AS 42. AS 12 prepends its assigned 
AS number in the AS path (which was previously empty, because network X originated in AS 
12). When the EBGP update arrives at the confederation member-AS 61, the AS-path attribute 
has been set to 12. 


The member-AS 61 has intra-confederation EBGP sessions to member-AS 62 and to member- 
AS 63. The router in AS 61 prepends its own AS number to the AS path. When doing this, it 
signals that this part of the AS path describes the intra-confederation AS path. When printed 
out, the intra-confederation part of the AS path is displayed within parentheses. Therefore, 
when member AS 61 sends the update to member-AS 62 and member-AS 63, the route to 
network X has an AS-path attribute set to (61) 12. 


Within a member-AS, the router sends the update using classic IBGP. The router does not 
modify the AS path when transmitting it over an IBGP session. 


Member-AS 62 and member-AS 63 both prepend their AS number, so member-AS 64 receives 
the update about the route to X via two different paths, one with AS path (62 61) 12 and the 
other with AS path (63 61) 12. 


Member-AS 64 selects one of the alternatives as the best BGP route. It then forwards this 
update on the intra-confederation EBGP session. This update could introduce a loop, but if the 
update was ever to be forwarded all the way back up to member-AS 61, the loop would be 
detected and member-AS 61 would silently ignore the update. 
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6-60 


Member-AS 64 also forwards the update about network X on a true EBGP session to AS 14. 
When it does, it removes all the parenthesized information in the AS path and replaces it with 
the official AS number of the confederation, 42. AS 14 thus receives the update about network 
X with an AS path that is set to 42 12. 


The routers in AS 14 select the best path based on the length of the AS path if no other policy is 
configured. AS14 will see the route to X with an AS-path length of two. When AS 14 forwards 
packets that are destined for network X into the confederation (AS 42), member-AS 64 must 
make a forwarding decision. This decision process inside the confederation will use both 
confederate AS paths for loop avoidance but not for choosing the shortest AS path within the 
confederation. The multiple step BGP path-selection process will treat both AS paths as equal 
and have to use the other attributes to select the preferred path. All else being equal, the BGP 
decision process chooses normal EBGP routes over confederation EBGP routes and 
confederation EBGP over IBGP routes. 
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AS-Path Processing in BGP Confederations 


This topic explains how the BGP AS-path attribute is processed within an AS that contains a 
BGP confederation. 


AS-Path Processing in 
BGP Confederations 


Intra-confederation AS path is encoded as a 
separate segment of the AS path. 


* Displayed in parentheses when you are using 
Cisco lIOS show commands. 


All routers within the BGP confederation have to 
support BGP confederations. 


¢ A router not supporting BGP confederations will 
reject AS path with unknown segment type. 


BGP v3.1—6-7 


When BGP routing updates are sent by BGP-speaking routers over a BGP session, the BGP 
attributes are encoded in a binary structure. The AS-path attribute, which is printed out and 
displayed as a text string, is actually a type, length, value (TLV) binary field, which is 
composed of several segments. The intra-confederation part of the AS path is encoded by the 
intra-confederation router as a separate segment of the AS path with a new type code. This 
segment of the AS path contains a sequence of AS numbers that encode the member 
autonomous systems that the BGP update has traversed. 


Because this segment is an extension to the original interpretation of the mandatory well-known 
BGP attribute AS-path, a BGP implementation that does not support BGP confederations will 
not understand the intra-confederation part of the AS path. If a router receives a BGP update 
with a mandatory well-known attribute that the router cannot interpret, it will send a 
notification to the neighbor that sent the offending update and terminate the session. A router 
that does not support BGP confederations, therefore, cannot operate inside a BGP 
confederation. 
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Intra-Confederation EBGP Session Properties 


6-62 


This topic describes EBGP sessions between different autonomous systems that are contained 
within the confederation. 


Intra-Confederation EBGP 
Session Properties 


Behaves like EBGP session during session 
establishment 
* EBGP neighbor has to be directly connected, or 


you have to configure ebgp-multihop on the 
neighbor. 


Behaves like IBGP session when propagating 
routing updates 


¢ Local preference, MED, and next-hop attributes are 
retained. 


¢ The whole confederation can run one IGP, 
providing optimal routing based on next-hop 
attribute in BGP routing table. 


Intra-confederation EBGP sessions, while having EBGP-like properties (for example, updating 
the AS-path attribute when propagating BGP routes), still run inside a real AS and therefore 
have to share some properties with IBGP sessions to achieve the same end results. Similar to 
IBGP sessions, the BGP attributes of local preference, multi-exit discriminator (MED), and 
next-hop are not changed in updates that are propagated across intra-confederation EBGP 
sessions. All routers in all member autonomous systems inside the confederation consequently 
use the same next-hop address when they are doing recursive routing. Because all intra- 
confederation routers use the same next-hop address, the entire confederation should use the 
same IGP to resolve the BGP next-hop address. The IGP information should not be limited by 
the member-AS boundary. 


On the other hand, intra-confederation EBGP sessions behave exactly like EBGP sessions when 
they are established. EBGP sessions are normally opened between directly connected 
interfaces. However, because all routers within the confederation run the same IGP and 
exchange internal routing information, there is no problem for them to open multihop sessions. 
Resiliency of BGP sessions and consequent stability of BGP routing are introduced into the 
network if the intra-confederation EBGP sessions are established between loopback interfaces, 
just like IBGP sessions normally are. 


When intra-confederation EBGP sessions are opened between loopback interfaces, the ebgp- 
multihop qualifier must be given to the session. Otherwise the EBGP session will never leave 
the Idle state. 
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Actually, the intra-confederation EBGP sessions could be established between intra- 
confederation routers in an arbitrary topology, not necessarily following the physical topology. 
The next hop of the route will always contain the IP address of a BGP router outside of the 
confederation, and packet forwarding will follow the optimal path, because recursive routing 
will rely on the IGP to reach the BGP next hop. The intra-confederation EBGP sessions are 
merely used to distribute the BGP updates to all member autonomous systems. To avoid 
unnecessary duplication of routing updates, network designers should take great care when 
designing the topology of the intra-confederation EBGP sessions. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
isc co 


BGP confederations are a scalability mechanism that relaxes 
the IBGP full-mesh requirements of classic BGP. 


The full-mesh requirement is relaxed through introduction of 
member autonomous systems into which the original 
autonomous system is split. 


The additional autonomous system numbers are hidden 


from the outside world by modified AS-path update 
procedures. 


The intra-confederation segment is removed from the AS 
path by the egress confederation router prior to prepending 
the official AS number when sending a BGP update to an 
external AS. 


Intra-confederation EBGP sessions act like EBGP sessions 
from a session establishment perspective, and they act like 
IBGP sessions from the BGP attribute propagation 
perspective. 


References 


For additional information, refer to this resource: 


= For more information on BGP confederations, refer to “Using the Border Gateway Protocol 
for Interdomain Routing” at the following URL: 
http://www.cisco.com/univercd/cc/td/doc/cisintwk/ics/icsbgp4.htm 
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Configuring and Monitoring 
Confederations 


Overview 


This lesson introduces the steps that are required to successfully migrate an existing AS to BGP 
confederations. It also presents the Cisco IOS commands that are required to configure and 
monitor confederations. 


Relevance 


Large BGP networks cannot properly scale without relying on performance-enhancing tools 
such as route reflectors and confederations. Confederations enable BGP routing information to 
be distributed in a fashion that does not require a physical full-mesh network. Implementing 
such a network requires knowledge of the steps to properly migrate and configure BGP 
confederations, and the commands that are used to verify the operation of the configured 
network. 


Objectives 


Upon completing this lesson, you will be able to describe the configuring and monitoring of 
confederations. This includes being able to meet these objectives: 


m List the design rules for migrating an existing IBGP backbone to BGP confederations 
m Plan the migration of an existing IBGP backbone toward BGP confederations 


m Identify the Cisco IOS commands that are required to configure BGP confederations on a 
BGP backbone 


m Identify the Cisco IOS commands that are required to monitor a BGP backbone that 
contains BGP confederations 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 
m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 
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Outline 


The outline lists the topics included in this lesson. 


Outline 
OE EO Cisco.com 


° Overview 

° BGP Confederation Design Rules 
¢ Planning BGP Confederations 

° Configuring BGP Confederations 


¢ Monitoring BGP Confederations 


° Summary 
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BGP Confederation Design Rules 


This topic describes the basic design rules that network designers should follow when planning 
a transit AS for BGP confederations. 


BGP Confederation Design Rules 


IBGP full mesh within each member-AS is 
required. 


* Route reflectors might be used within each AS 
to relax the IBGP full-mesh requirements. 


No topology limitation on EBGP sessions 
between autonomous systems within 
confederation. 


° The intra-confederation EBGP sessions will 
follow the physical topology of the network. 


BGP v3.1—6-3 


When designing BGP confederations, keep in mind two basic design rules: 
m There are no restrictions on intra-confederation EBGP sessions. 


m= A full mesh of IBGP sessions is still needed inside every member-AS. 


BGP confederations do not modify IBGP behavior, and, therefore, the classic IBGP split- 
horizon rules still apply. As a result, a full mesh of IBGP sessions between all routers in the 
member-AS is required. The basic idea of BGP confederations is to make the member-AS 
smaller than the original, larger AS so that the full mesh will not be too complex. Route 
reflector functionality is also available within a member-AS to reduce the complexity of IBGP 
sessions if needed. 


In theory, the member autonomous systems may be interconnected by intra-confederation 
EBGP sessions in an arbitrary topology. However, a structure that is too complicated introduces 
unnecessary duplication of information. There is no split-horizon function on EBGP sessions, 
meaning that in a redundant configuration, where a BGP update may be forwarded by a router 
over two different member autonomous systems to reach a third member-AS, the receiving 
member-AS will get both copies of the update. 


Experience shows that a centralized confederation design leads to the best behavior. 
Centralized design means that all member autonomous systems will exchange information with 
each other via a central member-AS backbone. 
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On the other hand, too few intra-confederation EBGP sessions may introduce single points of 
failure. If two member autonomous systems are redundantly connected on the physical level 
but have only a single intra-confederation EBGP session between them, a single point of failure 
is introduced. 


Good network design should never introduce additional single points of failure. If the physical 
topology is redundant, then the intra-confederation EBGP sessions should be redundant as well. 


In a hierarchical network topology, the network core could serve as a central member-AS 
backbone. The more peripheral parts of the network could be divided into several member 
autonomous systems that are all connected to the central member-AS. 
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Planning BGP Confederations 


This topic describes how to plan a BGP backbone for a configuration that includes BGP 
confederations. 


Planning BGP Confederations 


Divide transit AS into smaller areas. 
* Follow physical topology of the network. 
Define AS number for each area. 


¢ Use AS numbers reserved for private use 
(64512 — 65535). 


Verify Cisco IOS release level. 
° All routers have to support BGP confederations. 


Convert each area into autonomous 
system. 


¢ Total rewrite of BGP configuration is required. 


BGP v3.1—6-4 


The physical topology of the AS serves as a guide to design the confederation. You should 
introduce no additional single points of failure when implementing the confederation. If the 
physical topology is redundant, good practice is to have redundant intra-confederation EBGP 
sessions. If the physical topology is not redundant, introducing a nonredundant set of sessions 
does not add a single point of failure—the network was already nonredundant. 


You need to make the following preparations before migrating from a full mesh of IBGP 
sessions to a confederation design: 


m™ Identify a group of core routers that can serve as a central member-AS. 

m™ Identify several groups of more peripheral routers where, within each group, routers are 
well connected. Let each group be its own member-AS. 

m Make a plan how to assign AS numbers (64512 — 65535) to your member-AS. The plan 
must uniquely identify each member-AS within the confederation. Each member-AS is not 
seen from outside the confederation, so you do not need to coordinate the plan with any 
other AS. 

m Make sure that no router is lacking support (correct Cisco IOS release level) for a BGP 
confederation. If any router does, it will break the network. 

m Remove the original BGP configuration with the original official AS number. 

Note Support for the BGP confederation feature is included in Cisco IOS software since version 

10.3. 
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Configuring BGP Confederations 


This topic describes how to configure BGP confederations on a BGP backbone. An example of 
a BGP confederations configuration is also included in this topic. 


Configuring BGP Confederations 


Start BGP process with member-AS number. 
Specify external AS number 
¢ Must be defined in all routers within confederation. 


List all member-AS numbers in the 
confederation 


¢ Must be defined in all routers with an EBGP session. 


After you have done the preparation that is necessary to migrate from a full mesh of IBGP 
sessions to a confederation design, you need to complete the following configuration steps: 


m Make anew BGP configuration that uses the internal member-AS number according to the 
AS number plan for the confederation. 

m Specify the original official AS number as the identifier of the confederation. This 
information will be used by egress confederation routers whenever you are communicating 
with other external autonomous systems. 

m Specify a list of the member-AS numbers being used. The router uses this information to 
distinguish between intra-confederation EBGP behavior and true EBGP behavior. 

m= Configure all the IBGP sessions in the full mesh within the member-AS. 

= Configure intra-confederation EBGP sessions between each member-AS in a way that 
introduces no additional single point of failure. 

= Configure true EBGP sessions with external autonomous systems. 

Note Removing the original BGP configuration and creating a new BGP configuration will always 
cause interruption in network availability. Migration to BGP confederation has to be a well- 
planned process. 
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Configuring BGP 


Confederations (Cont.) 
er nn ONEruN anny 


router (config) # 


no router bgp as-number 
router bgp member-as-number 


* Removes old BGP process and configures BGP 
process with member-AS number 


router (config-router) # 


bgp confederation identifier external-as-number 


* Configures external confederation-wide AS number 


router (config-router) # 


bgp confederation peers list-of-intra-confederation-as 


* Defines all the other autonomous systems in the 
confederation 


router bgp 
To configure the BGP routing process, use the router bgp global configuration command. 
™ router bgp as-number 
To remove a routing process, use the no form of this command. 
= no router bgp as-number 
Syntax Description 
Parameter Description 
as-number Number of an AS that identifies the router to other BGP routers 
and tags the routing information that is passed along 
Note The AS number that is specified when you are configuring a BGP process inside a 
confederation is the intra-confederation (member) AS number. 
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bgp confederation identifier 


To specify a BGP confederation identifier, use the bgp confederation identifier router 
configuration command. 


= bgp confederation identifier external-as-number 


To remove the confederation identifier, use the no form of this command. 


= no bgp confederation identifier external-as-number 


Syntax Description 


Parameter Description 


external-as-number Public AS number that the confederation is using externally. 


bgp confederation peers 
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To configure the autonomous systems that belong to the confederation, use the bgp 
confederation peers router configuration command. 


= bgp confederation peers as-number [as-number] 


To remove an AS from the confederation, use the no form of this command. 


= no bgp confederation peers as-number [as-number |] 


Syntax Description 


Parameter Description 


AS numbers of member autonomous systems inside the 
confederation. This list is used by the router to distinguish an 
intra-confederation EBGP session from a real EBGP session with 
an external AS. 


as-number 
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Example 


Configuring BGP Confederations—Sample 


Configuration 
pe eee CISCO.COM 


Internal AS Internal AS router bgp 65001 ! internal AS 
65003 ! 


! Confederation parameter 

bgp confederation identifier 123 
bgp confederation peers 65002 65003 
! 


! IBGP neighbor 
Internal AS neighbor 1.0.0.3 remote-as 65001 
65001 ! 
! EBGP with intra-confed AS 
neighbor 1.0.0.2 remote-as 65002 
neighbor 1.0.0.1 remote-as 65003 
' 


! real EBGP 
neighbor 2.7.1.1 remote-as 222 


BGP v3.1—6-7 


This example illustrates the use of confederation-related BGP configuration commands. 


Note The example shows only a portion of the configuration of router 1.0.0.4. The configuration 
displayed is not a complete configuration—only those parts that are relevant to BGP 
confederations are displayed. 


AS 123 is transformed into a BGP confederation. The member-AS 65001 serves as a central 
member-AS. Member autonomous systems 65002 and 65003 are connected to AS 65001. From 
the outside, the confederation looks like a single AS, still identified by AS number 123. 


The internal member-AS number is specified in the router bgp configuration command. This 
number is the AS number that will be prepended to the AS-path attribute by the router when 
updates are forwarded across intra-confederation EBGP sessions. 


The original, official AS number is given as the BGP confederation identifier. This number is 
the AS number that will replace the internal member-AS information when egress 
confederation routers forward updates across EBGP sessions with external autonomous 
systems. 


The bgp confederation peers configuration step allows the router to identify the type of 
session to be opened with the BGP peers that are configured through the neighbor statement. 


Neighbor 1.0.0.3 is in the same member-AS, so its session is an IBGP session. Both neighbor 
1.0.0.2 (AS 65002) and 1.0.0.1 (AS 65003) belong to different member autonomous systems 
(the AS number appears in the list of BGP confederation peers), so their sessions are intra- 
confederation EBGP sessions. 
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Neighbor 2.7.1.1 belongs to AS 222, which is not listed as a member-AS in the bgp 
confederation peers command, so its session is a true EBGP session. 
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Monitoring BGP Confederations 


This topic explains the basic commands that are used to monitor a BGP backbone that you have 
configured with BGP confederations. 


Monitoring BGP Confederations 


router> 


show ip bgp neighbors 


¢ Displays whether a neighbor is within the 
confederation 


router> 


show ip bgp prefix [mask] 


* Displays internal and external segments of the AS- 
path attribute 


* Displays whether the path is external, internal, or 
intra-confederation external 


BGP v3.1—6-8 
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show ip bgp neighbors 


To display information about the TCP and BGP connections to neighbors, use the show ip bgp 
neighbors EXEC command. 


m= show ip bgp neighbors [address] [received-routes | routes | advertised-routes | {paths 
regular-expression} | dampened-routes | 


Syntax Description 


Parameter Description 

address Address of a specific neighbor about which you wish to display 
information. If you omit this argument, all neighbors are 
displayed. 

received-routes Displays all received routes (both accepted and rejected) from 
the specified neighbor. 

routes Displays all routes that are received and accepted. This is a 
subset of the output from the received-routes keyword. 

advertised-routes Displays all the routes that the router has advertised to the 
neighbor. 

paths regexp Regular expression that is used to match the paths that are 
received. 

dampened-routes Displays the dampened routes to the neighbor at the IP address 


that is specified. 


If the show ip bgp neighbors command is executed on a router without any keywords, the 
resulting information that is displayed does not show routes or paths that are received by the 
router, but instead shows the status of its neighbor sessions. 


show ip bgp 
To display entries in the BGP routing table, use the show ip bgp EXEC command. 
m= =show ip bgp [network] [network-mask] [longer-prefixes] 
When details are displayed for a specific route entry in the BGP table, the next hop and AS path 


are displayed along with information that indicates whether a BGP update was received over an 
intra-confederation EBGP session or a regular EBGP session. 


Syntax Description 


Parameter Description 
network Network number, which is entered to display a particular network 
in the BGP routing table 
network-mask Displays all BGP routes that match the address and mask pair 
longer-prefixes Displays the network route and its more specific routes 
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Monitoring Intra-Confederation 


EBGP Neighbors 
IR 


router# show ip bgp neighbor 1.0.0.4 
BGP neighbor is 1.0.0.4, remote AS 65002, external link 
Index 2, Offset 0, Mask 0x4 
BGP version 4, remote router ID 12.1.2.3 
Neighbor under common administration 
BGP state = Established, table version = 5, up for 00:09:15 
Last read 00:00:16, hold time is 180, keepalive interval is 60 seconds 
Minimum time between advertisement runs is 30 seconds 
Received 13 messages, O notifications, 0 in queue 
Sent 13 messages, 0 notifications, 0 in queue 
Prefix advertised 1, suppressed 0, withdrawn 0 
Connections established 1; dropped 0 
Last reset never 
1 accepted prefixes consume 32 bytes 
0 history paths consume 0 bytes 
External BGP neighbor may be up to 255 hops away 


002G_035 
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In the figure, the show ip bgp neighbors command has been executed on a router within a 
confederation. As a result, information about the intra-confederation EBGP session is 
displayed. The session is an external link (indicating an EBGP session) under common 
administration (indicating an intra-confederation EBGP session). 
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Monitoring Confederation Routes 
a a nent 


Route received from intra- 
confederation IBGP session 


Next hop points to real 
EBGP peer in both cases 


router# show ip bgp 14.0.0.0 
BGP routing table entry for 14.0.0.0/8, version 5 
Paths: (2 available, best #2, advertised over IBGP, EBGP) 
(65001) 387 
1.3.0.3 (metric 54357248) from 1.0.0.1 (11.0.0.1) 
Origin IGP, metric 0, localpref 60, valid, confed-internal 
(65001) 387 < 
1.3.0.3 (metric 54357248) from 1.0.0.2 (10.1.1.1) 
Origin IGP, metric 0, localpref 60, valid, confed-external, 
best 


Intra-confederation External part of 
part of AS path AS path 


Route received from inter- 
confederation EBGP session |: 


In this example, the show ip bgp command is executed on a router within the confederation to 
display information about the class A network 14.0.0.0. 


The command response indicates that the router has received information about the network 
14.0.0.0 on two different BGP sessions. One of the sessions is an intra-confederation EBGP 
session, and the other session is an IBGP session. Both updates have the same next-hop 
address, which was set by the true EBGP peer that originally sent the update into the 
confederation. The next hop is resolved by recursive routing, and, therefore, the forwarding 
decision will be the same regardless of which BGP entries are actually used. The second IP 
address is the address of the neighbor, which is followed by the router-ID of that neighbor 
(enclosed in parentheses). 


The AS path is the same for both entries. It contains a parenthesized part, (65001). This is the 
part of the AS path that describes the intra-confederation AS path. The part of the AS path that 
follows is the external part, 387. This number reveals that the confederation has a true EBGP 
session with the official AS (AS 387), from which an update about network 14.0.0.0 was 
received. The update was forwarded to the router using IBGP within member-AS 65001. The 
router in the local member-AS, on which this command was executed, has two different intra- 
confederation EBGP sessions with member-AS 65001. So, the update about network 14.0.0.0 
has entered the local AS via two different paths. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 


isc cor 


¢ BGP confederations do not modify IBGP behavior; 
thus, the classic IBGP split-horizon rules still apply, 
and a full mesh of IBGP sessions between all 
routers in the member AS is still required. 


¢ A proper migration plan is important because the 


change to BGP confederation involves a major 
reconfiguration of BGP routing. 


* BGP confederations are configured by specifying 
the confederation identifier and other member 
autonomous system peers. 


° The show ip bgp neighbors command has been 
modified to display whether a BGP neighbor is part 
of a BGP confederation. 


References 


For additional information, refer to these resources: 


m= For more information on BGP confederations, refer to “Using the Border Gateway Protocol 


for Interdomain Routing” at the following URL: 
http://www.cisco.com/univercd/cc/td/doc/cisintwk/ics/icsbgp4.htm 


m= For more information on BGP confederations, refer to “Autonomous System 


Confederations for BGP” at the following URL: 
http://www. ietf.org/rfc/rfc1965.txt?number=1965 


Next Steps 


For the associated lab exercise, refer to the following section of the course Lab Guide: 


m= Lab Exercise 6-2: Configuring and Monitoring Confederations 
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Lesson Assessments 


Overview 


Use the lesson assessments here to test what you learned in this module. The correct answers 
and solutions are found in the Lesson Assessment Answer Key. 


Outline 


This section includes these assessments: 


Quiz 6-1: Scaling IGP and BGP in Service Provider Networks 
Quiz 6-2: Introducing Route Reflectors 

Quiz 6-3: Designing Networks with Route Reflectors 

Quiz 6-4: Configuring and Monitoring Route Reflectors 

Quiz 6-5: Introducing Confederations 


Quiz 6-6: Configuring and Monitoring Confederations 
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Quiz 6-1: Scaling IGP and BGP in Service 
Provider Networks 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 


Quiz 


Describe the basic structure of service provider networks 
Describe the propagation of internal and customer routes in service provider networks 
Describe proper scaling of IGPs and BGP in service provider networks 


Describe issues concerning the scaling of IP addressing in service provider networks 


Answer these questions: 


Ql) 


Q2) 


Q3) 
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Which three characteristics are common to typical service provider networks? 

(Choose three.) 

A) The provider network uses two IGPs, one for customer routes and one for 
internal provider routes. 

B) Service providers exchange routes with other providers using BGP. 

C) Service providers run IBGP within their network in addition to their IGP 
requirements. 

D) Service providers typically use either static routes or EBGP with their 
customers. 

What is the typical role of an IGP within a service provider network? 

A) The IGP carries customer routes for redistribution into BGP at the provider 
edge. 

B) The IGP advertises a default route to customers of the service provider. 

C) The IGP resolves next-hop IP addresses. 

D) The IGP carries BGP routes across the provider network. 

Why should you avoid the use of private IP addressing in service provider networks? 

A) Private addressing can prevent customer network troubleshooting utilities such 
as traceroute from functioning correctly. 

B) Private IP addressing is not allowed on the Internet and will not function in a 
service provider network. 

C) Private IP addressing prevents the service provider from properly summarizing 
customer routes if it is also using private address space. 

D) Private IP addressing prevents service provider applications such as MPLS 


from operating properly in an Internet-supporting environment. 
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Q4) Which three requirements are key to properly scaling BGP in a service provider 
environment? (Choose three.) 


A) IBGP full-mesh scaling tools to reduce duplicate traffic within the AS 


B) summarization of customer routes to reduce the number of prefixes that are 
carried 

C) improvement in BGP convergence time by using the IGP for route propagation 
within the provider AS 

D) proper scaling of the AS-wide routing policy to ease administration and 


maintenance requirements 


Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 6-2: Introducing Route Reflectors 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 


Quiz 


Explain the need for BGP route reflectors 

Explain how route reflectors modify traditional IBGP split-horizon rules 
Explain the benefits of deploying redundant route reflectors 

Describe the concept of route reflector clusters 


Describe additional route reflector mechanisms that have been designed to prevent routing 
loops 


Answer these questions: 


Ql) 


Q2) 


Q3) 


Q4) 
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What is the main problem that is solved by implementing BGP route reflectors? 


A) the large number of routes that are carried in the IGP when BGP is deployed 
B) the ability for BGP to scale a single AS in a large network 


C) the need for a homogeneous method of applying policies to routes that are 
carried through an AS 
D) the ability to support service-level parameters with greater ease 


How does a route reflector modify the IBGP split-horizon rule? 


A) Route reflectors forward EBGP updates onto all peers (IBGP and EBGP). 

B) Route reflectors treat all neighbors as EBGP peers, which eliminates the IBGP 
mesh requirements. 

C) Route reflectors forward IBGP updates from clients to other IBGP neighbors. 

D) Route reflectors append the cluster-ID to the AS path, which allows peers to be 
treated as EBGP neighbors. 


Why are redundant route reflectors mandatory in any high-availability network design? 


A) because all neighbors peer with the route reflector, and a large number of 
neighbors can make the route reflector router unstable 

B) because EBGP peers can inject BGP updates into the AS only through the 
route reflector 


C) because route reflectors maintain more routing information, which makes them 
more prone to congestion and failure 

D) because clients can form IBGP relationships only with the route reflector 

What is the main reason for implementing redundant route reflectors with clusters? 

A) to eliminate routing loops in redundant configurations 

B) to limit the number of neighbor sessions with each route reflector 

C) to provide another scalability mechanism targeted at removing the IBGP full- 
mesh requirement 

D) to enhance security within the AS 
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Q5) How does the originator-ID attribute assist in the elimination of routing loops that are 
caused by redundant route reflector designs? 


A) If the originator-ID matches the router-ID of the reflector, local preference is 
set on the route to make it a backup. 

B) The originator-ID attribute is set to the cluster-ID to ensure that a route 
traverses the AS only one time. 

C) A router that receives a route in which the originator-ID matches its router-ID 
will ignore that route. 

D) The originator-ID allows the router to know if the route originated locally or 


from an external source so that administrative distance rules for the route can 
be verified. 


Scoring 


You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 6-3: Designing Networks with Route 


Reflectors 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 


m List the network design rules for implementing BGP route reflectors 


m List the potential issues that can arise if you do not follow the route reflector network 


design rules 


m Explain the purpose and function of hierarchical route reflectors 


Quiz 


Answer these questions: 


Q1) ~~ What can occur if a client has IBGP neighbor relationships with other routers that are 
not configured as route reflectors? 


This is an invalid configuration. 

The client will notify the route reflector and be promoted to a route reflector as 
well. 

Routing black holes can occur and cause lost traffic inside the AS. 
Unnecessary routing traffic will be generated. 


Q2) — Which potential problem can occur if a client does not have an IBGP session with all 
route reflectors in a cluster? 


A) This is an invalid configuration. 
B) The client might not receive all BGP routes. 
C) EBGP routes that are received by the client will not be distributed properly 
throughout the AS. 
D) Duplicate routing traffic will be sent to the client. 
Q3) — Which problem are hierarchical route reflectors designed to solve? 
A) lack of a consistent application of security and routing policies throughout the 
AS 
B) scalability of autonomous systems in very large routing domains 
C) routing loops caused by redundant cluster configurations 
D) administrative overhead when you are implementing router reflector network 
designs 
Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 6-4: Configuring and Monitoring Route 
Reflectors 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 
m List the steps to migrate an existing IBGP backbone to a backbone with route reflectors 


m Identify the Cisco IOS commands that are required to configure route reflectors on a BGP 
backbone 


m Identify the Cisco IOS commands that are required to monitor a BGP backbone that 
contains route reflectors 


Quiz 
Answer these questions: 


Q1) Which two BGP parameters do you have to configure on a route reflector? 
(Choose two.) 
A) cluster-ID 
B) originator-ID 
C) cluster-list 
D) route reflector clients 


Q2) What are three migration steps that are required to convert from a fully meshed IBGP 
AS to an AS that is based on route reflectors? (Choose three.) 


A) remove unnecessary IBGP sessions 

B) configure the clients on the route reflectors 

C) configure IBGP sessions between route reflector clients 
D) configure the cluster-ID on the route reflectors 


Q3) |= Which command should you use to identify route reflector clients without inspecting 
the router configuration? 
A) show ip bgp prefix 
B) show ip bgp neighbors 


C) show ip bgp clients 
D) show ip bgp summary 


Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 6-5: Introducing Confederations 


Complete this quiz to assess what you learned in the lesson. 


Objectives 


This assessment tests your knowledge of how to: 


Quiz 


6-88 


Explain the need for BGP confederations 


Explain the concept of AS splitting with BGP confederations 


Describe AS-path propagation in BGP confederations 


Explain AS-path attribute processing in an AS that contains BGP confederations 


Explain the properties of intra-confederation EBGP sessions 


Answer these questions: 


Ql) 


Q2) 


Q3) 


Configuring BGP on Cisco Routers (BGP) v3.1 


What is the main problem that is solved by implementing BGP confederations? 


A) 
B) 
C) 


D) 


the large number of routes that are carried in the IGP when BGP is deployed 
the ability for BGP to scale a single AS in a large network 

the need for a homogeneous method of applying policies to routes that are 
carried through an AS 

the ability to support service level parameters with greater ease 


Although confederations eliminate the need for a fully meshed topology within the AS, 
where does the BGP full-mesh requirement still apply? 


A) 
B) 
C) 
D) 


to all EBGP neighbor sessions 

inside each member AS 

between the member autonomous systems in the confederation 
no longer applies when confederations are used in an AS 


How does an IBGP router that receives the AS-path attribute in a BGP update 
determine if the route has crossed a member-AS within a confederation? 


A) 
B) 
C) 


D) 


The router can determine this fact by the presence of the confederation bit in 
the flag field of the BGP update. 

The router can determine this fact because the AS-path attribute will contain 
only the AS number of the ingress EBGP peer. 

The member-AS numbers will be indicated by the presence of parentheses 
surrounding the AS number entry. 

The IBGP router cannot determine whether the route has crossed a member-AS 
because the AS number of each AS boundary that has been crossed is 
appended to the AS-path attribute. 
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Q4) How does an EBGP router that receives the AS-path attribute in a BGP update 
determine if the route has crossed a member-AS within a confederation? 


A) 
B) 
C) 


D) 


The router can determine this fact by the presence of the confederation bit in 
the flag field of the BGP update. 

The router can determine this fact because the AS-path attribute will contain 
only the AS number of the ingress EBGP peer. 

The member-AS numbers will be indicated by the presence of parentheses 
surrounding the AS number entry. 

The EBGP router cannot determine whether the route has crossed a member- 
AS because the member-AS entries are removed from the AS path prior to 
exiting the confederation. 


Q5) Why is it not possible for a router that does not support BGP confederations to operate 
inside an AS that is configured as a confederation? 


A) 
B) 
C) 


D) 


The router will believe that the AS path is longer than the actual AS path and 
route incorrectly. 

The router will be unable to interpret the AS-path attribute and terminate its 
BGP session with a peer. 

The router will automatically convert the intra-confederation AS numbers to 
the external AS number of the confederation, causing an AS number mismatch. 
The router will process BGP updates as normal because it has to be aware only 
of the member-AS to which it belongs, causing incorrect routing information to 
propagate through the AS. 


Q6) = Which three IBGP properties are retained within the confederation even though EBGP 
sessions between member autonomous systems are formed? (Choose three.) 


A) local preference 
B) MED 
C) weight 
D) next-hop 
Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 6-6: Configuring and Monitoring 
Confederations 


Complete this quiz to assess what you learned in the lesson. 


Objectives 
This assessment tests your knowledge of how to: 
m List the design rules for migrating an existing IBGP backbone to BGP confederations 
m Plan the migration of an existing IBGP backbone toward BGP confederations 


m Identify the Cisco IOS commands that are required to configure BGP confederations on a 
BGP backbone 


m Identify the Cisco IOS commands that are required to monitor a BGP backbone that 
contains BGP confederations 


Quiz 
Answer these questions: 


Q1) How can you reduce the IBGP full mesh within a confederation AS? 


A) You cannot reduce the full mesh because all IBGP peers must be fully meshed 
within the member-AS. 

B) Implementing router reflectors inside a member-AS can reduce the IBGP full- 
mesh requirement. 

C) You can nest a confederation within a confederation to remove the IBGP full- 
mesh requirement. 

D) Because confederations are used, there is no requirement for an IBGP full 


mesh within each member-AS. 


Q2) Which two BGP parameters do you need to specify on every router within a 
confederation? (Choose two.) 


A) a list of all AS numbers in the confederation 

B) a list of all true EBGP sessions 

C) the official AS number (as the identifier of the confederation) 
D) the correct MD5 authentication password in each peer 


Q3) — What does the BGP confederation identifier define? 


A) the AS number of the confederation external peer 

B) the public AS number that the confederation is using externally 
C) the AS number of the member-AS 

D) the MD5 authentication password for the confederation 


Q4) How will the show ip bgp command display the intra-confederation segment of the AS 
path? 


A) as a regular entry in the AS-path attribute 
B) as a separate AS-path list independent of the AS-path attribute 


C) as an entry in the AS path enclosed by parentheses 
D) The intra-confederation AS is not displayed because it is not a part of the 
EBGP AS path. 
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Scoring 


You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Lesson Assessment Answer Key 


Quiz 6-1: Scaling IGP and BGP in Service Provider Networks 
Q)~—so«&BGD 
Q2) oc 
Q3) A 
Q4) = A,B,D 


Quiz 6-2: Introducing Route Reflectors 


Ql) B 
Q2) Cc 
Q3) D 
Q4) A 
Qs) Cc 


Quiz 6-3: Designing Networks with Route Reflectors 


Ql) D 
Q2) B 
Q3) B 


Quiz 6-4: Configuring and Monitoring Route Reflectors 


Ql) A,D 
Q2) A, B,D 
Q3) B 


Quiz 6-5: Introducing Confederations 
QD 
Q2) —~2B 

Q3) =C 

Q4) OD 

Qs) B 

A 


Q6) ,B,D 


Quiz 6-6: Configuring and Monitoring Confederations 


Q1) B 
Q2) A,C 
Q3) B 
Q4) C 
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Module 7| 


Optimizing BGP Scalability 


Overview 


The Border Gateway Protocol (BGP) is designed for reliability and scalability. As such, it has 
become the de facto standard protocol that is used to carry more than 110,000 prefixes in the 
Internet today. Likewise, BGP has a tremendous amount of flexibility with regard to 
administrative policy controls, route selection, performance tuning, and scalability features. 
This module introduces advanced BGP configuration tools that are designed to improve BGP 
scalability and performance. Tools that are discussed in this module include convergence time 
reduction features; limiting the number of prefixes; peer groups; and route dampening. 


Module Objectives 


Upon completing this module, you will be able to reduce BGP convergence time. This includes 
being able to meet these objectives: 


Module Objectives 


¢ Configure Cisco IOS performance 
improvements to reduce BGP convergence 
time 

¢ Successfully configure BGP to limit the 
number of prefixes that are received froma 
neighbor 


e Use BGP peer groups to share common 
configuration parameters between multiple 
BGP peers 


¢ Use route dampening to minimize the impact 
of unstable routes 
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Module Outline 


The outline lists the components of this module. 


Module Outline 


° Improving BGP Convergence 


¢ Limiting the Number of Prefixes Received from 
a BGP Neighbor 


° Implementing BGP Peer Groups 


¢ Using BGP Route Dampening 
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Improving BGP Convergence 


Overview 


BGP is the routing protocol that is used to communicate between networks that are connected 
to the Internet. As the Internet routing table grows, service providers and large enterprise 
customers are experiencing a dramatic increase in the amount of time that BGP takes to 
converge. Networks that once converged in 10 or 15 minutes may now take up to an hour in 
some cases, and even longer in extreme situations. 


Several BGP enhancements have been made in Cisco IOS software to improve convergence 
and basic scaling properties. In addition, there are several steps that customers can take to 
further reduce BGP convergence times. This lesson introduces different Cisco IOS performance 
improvements that have been designed to reduce BGP convergence time. Included in this 
lesson are discussions of convergence, BGP routing processes, and the effects of BGP routing 
processes on router CPU resources. The lesson also discuses the commands that are required to 
configure and monitor BGP for different Cisco IOS performance improvements in the areas of 
path maximum transmission unit (PMTU) discovery, input hold queue, BGP scan time, and 
BGP advertisement interval. 


Relevance 


As the number of routes in the Internet increases, demands on router CPU and memory 
resources will increase. BGP processing affects both router resources and network convergence 
time. It is important that network convergence be as fast as possible to ensure accurate routing 
information between domains. It is also important that router resources be optimized whenever 
possible. Cisco IOS performance improvements for BGP are designed to aid network 
administrators in achieving these goals. 
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Objectives 


Upon completing this lesson, you will be able to reduce BGP convergence time. This includes 
being able to meet these objectives: 


m Describe convergence in BGP networks 

m Describe the function of BGP router processes 

m™ Describe the effects of BGP processes on router CPU resources 

m Identify Cisco IOS performance improvements to reduce BGP convergence time 


m™ Identify the Cisco IOS commands that are required to configure and monitor path MTU 
discovery 


m Identify the Cisco IOS commands that are required to configure and monitor the input 
queue depth on a router interface 


m™ Identify the Cisco IOS commands that are required to configure and monitor BGP scan 
time 


m Identify the Cisco IOS commands that are required to configure and monitor the BGP 
advertisement interval 


Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
EEO Cisco.com 


° Overview 

° BGP Convergence 

° BGP Processes 

¢ CPU Effects of BGP Processes 


° Improving BGP Convergence 
¢ Path MTU Discovery 

° Increasing Input Queue Depth 
° BGP Scan Time 

° BGP Advertisement Interval 


° Summary 
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BGP Convergence 


This topic describes the concept of convergence in BGP networks. 


BGP Convergence 


° As the number of routes in the Internet routing 
table grows, the time it takes for BGP to converge 
increases. 


¢ The Internet currently contains more than 110,000 
prefixes. 


* Network convergence times can range from 10 
minutes to more than one hour. 


* BGP is considered converged when: 
— All routes have been accepted 
— All routes have been installed in the routing table 


— The table version for all peers equals the table version of the 
BGP table 


— The input queue and output queue for all peers is 0 


As the number of routes in the Internet routing table grows, so too does the time that it takes for 
BGP to converge. In general, convergence is defined as the process of bringing all routing 
tables to a state of consistency. The BGP routing protocol is considered “converged” when the 
following conditions are true: 


m= All routes have been accepted. 

m= All routes have been installed in the routing table. 

m= The table version for all peers equals the table version of the BGP table. 
m= The input queue and output queue for all peers is 0. 


Convergence time is an important consideration in a network, because nonconverged networks 
can cause routing loops, packet delays, and even packet loss as a result of black holes. 
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BGP Processes 


This topic describes the different BGP router processes and their function. 


BGP Processes 


Process Description Interval 


BGP open Performs BGP peer establishment. At initialization, when 
establishing a TCP 
connection with a BGP 
peer 

BGP I/O Handles queuing and processing of BGP As BGP control 

packets (updates and keepalives). packets are received 


BGP scanner Walks the BGP table and confirms reachability | Every 60 sec 
of the next hops. BGP scanner also checks 
conditional advertisement to determine 
whether or not BGP should advertise 
condition prefixes. Performs route dampening. 
BGP router Calculates the best BGP path and processes Once per second and 
any route changes. It also sends and receives | when adding, 
routes, establishes peers, and interacts with removing, or soft- 
the routing information base (RIB). reconfiguring a BGP 
peer 


¢ BGP scanner and BGP router are responsible for a large amount of 
calculations and can lead to high CPU utilization. 
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In general, a Cisco IOS process consists of the individual threads and associated data that 
perform router tasks, such as system maintenance, packet switching, and implementing routing 
protocols. 


Note A thread is an information placeholder that allows a single process to be halted (interrupted) 
on the router so that the CPU can service another process. The information that is contained 
within the thread allows the interrupted process to restart exactly where it left off once the 
CPU is ready to service that process thread once again. 


Several Cisco IOS processes that are executed on the router enable BGP to run. You can use 
the show process cpu | include BGP command to see the amount of CPU resources that are 
consumed (utilization) because of running BGP processes. 


The figure lists the function of each of the BGP router processes and how often each process is 
executed on the router. It shows that each process runs at different times depending on the tasks 
that are handled by the specific process. Because BGP scanner and BGP router are responsible 
for a large amount of calculations, you may notice high CPU utilization during the running of 
either one of these processes. 
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CPU Effects of BGP Processes 


This topic describes how running BGP router processes affect router CPU resources. 


CPU Effects of BGP Processes 


BGP Scanner Process 


* High CPU utilization due to the BGP scanner 
process can be expected for short durations ona 
router carrying a large Internet routing table. 


¢ While the BGP scanner runs, low-priority 


processes need to wait a longer time to access 
the CPU. 


BGP Router Process 


¢ BGP router process runs about once per second 
to check for work. 


¢ BGP router consumes all free CPU cycles. 


On routers that carry a large Internet routing table, high CPU utilization due to the BGP scanner 
process can be expected for short periods of time. Once per minute, the BGP scanner “walks” 
(scans) the BGP routing table and performs important maintenance tasks. These tasks include 
checking the next hop that is referenced in the BGP table of the router and verifying that the 
next-hop devices can be reached. Thus, a large BGP table takes an equally large amount of time 
to be walked and validated. 


The BGP scanner walks the BGP routing table to update any data structures and walks the table 
for route redistribution purposes. In this context, the routing table is also known as the routing 
information base (RIB), which the router outputs when the show ip route command is 
executed. Both tables are stored separately in the router memory and can be very large, thus 
consuming CPU and memory resources. 


Because the BGP scanner runs through the entire BGP table, the duration of the high CPU 
utilization condition that is caused by the BGP scanner process varies with the number of 
neighbors and the number of routes that are learned per neighbor. 


While the BGP scanner runs, low-priority processes need to wait a longer time to access the 
CPU. One low-priority process controls Internet Control Message Protocol (ICMP) packets 
such as pings. Packets that are destined to or have originated from the router may experience 
higher than expected latency because the ICMP process must wait behind the BGP scanner. 
The BGP scanner process runs for some time, is suspended, then ICMP runs, ICMP is 
suspended, the BGP scanner runs, and so on. In contrast, pings sent through a router should be 
switched via Cisco Express Forwarding (CEF) and should not experience any additional 
latency. When you are troubleshooting periodic spikes in latency, compare forwarding times 
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for packets that are forwarded through a router versus packets that are processed directly by the 
CPU on the router. 


The BGP router process runs about once per second to check for work. BGP convergence 
defines the duration between the time when the first BGP peer is established and the point at 
which BGP is converged. To ensure the shortest possible convergence times, the BGP router 
consumes all free CPU cycles. However, after it starts, it relinquishes (or suspends) the CPU 
intermittently. 


Example 


7-8 


Convergence time is a direct measurement of how long the BGP router process runs on the 
CPU, not the total time that the process is actually running. This example investigates the high 
CPU utilization condition during BGP convergence as BGP exchanges prefixes with two 
External Border Gateway Protocol (EBGP) peers. 


Step 1 Capture a baseline for normal CPU utilization before starting the test. 


router# show process cpu 

CPU utilization for five seconds: 0%/0%; one minute: 4%; five minutes: 5% 

Step 2 Once the test starts, the CPU reaches 100 percent utilization. The show process cpu 
command shows that the high CPU condition is caused by the BGP router, denoted 
by 139 (the Cisco IOS process ID for the BGP router) in the following output: 

router# show process cpu 

CPU utilization for five seconds: 100%/0%; one minute: 99%; five minutes: 


81% [output omitted] 139 6795740 1020252 6660 88.34% 91.63% 74.01% 0) 
BGP Router 


Step 3 Monitor the router by capturing multiple outputs of the show ip bgp summary and 
show process cpu commands during the event. The show ip bgp summary 
command captures the state of the BGP neighbors. 


router# show ip bgp summary 


Neighbor Vv AS MsgRcevd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd 
LO Teale: 4 64512 309453 157389 19981 QO 253 22:06:44 111633 
172.16.1.1 4 65101 188934 1047 40081 41 0 00:07:51 58430 


Step 4 When the router completes prefix exchange with its BGP peers, the CPU utilization 
rates should return to normal levels. The computed 1-minute and 5-minute averages 
will settle back down as well but may show higher than normal levels for a longer 
period than the 5-second rate. 


router# show process cpu 


2 2 


CPU utilization for five seconds: 3%/0%; one minute: 82%; five minutes: 91% 


Step 5 Using the output from the show commands will allow you to compute the BGP 
convergence time. In particular, the "Up/Down" column of the show ip bgp 
summary command is compared to the start and stop times of the high CPU 
utilization condition. Typically, BGP convergence can take several minutes when 
routers exchange a large Internet routing table. 
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Improving BGP Convergence 


This topic identifies Cisco IOS performance improvements that reduce BGP convergence 
times. 


Improving BGP Convergence 


You can reduce BGP convergence time and high CPU 
utilization caused by BGP processes in the following 
ways: 

* Queuing to TCP peer connections 


— BGP now automatically queues data aggressively from the 
BGP OutQ to the TCP socket for each peer 


* Deploying BGP peer groups 
— Simplifies BGP configuration and enhances BGP scalability 
* Enabling the path MTU feature 


— Improves efficiency by dynamically determining the largest 
MTU that you can use without creating packets that need to 
be fragmented 


° Increasing interface input queues 
— Improves convergence by reducing dropped TCP ACKs 


BGP convergence can often be an issue in networks, requiring quick propagation of routing 
information. Cisco IOS software provides the following performance-improvement features, 
which have been designed to reduce BGP convergence time and the high CPU utilization that is 
caused by a running BGP process: 


™ Queuing to TCP peer connections: Instead of queuing data once per second, BGP now 
queues data aggressively from the BGP output queue to the TCP socket for each peer until 
the output queues have drained completely. Because BGP now sends at a faster rate, it 
converges more quickly. 


= BGP peer groups: The major benefit of specifying a BGP peer group is that it reduces the 
amount of system resources (CPU and memory) that are used in BGP update generation. 
Peer groups also simplify BGP configuration because many repetitive configuration 
elements (such as filters) are applied by the router only once (to the peer group) instead of 
applying them to each neighbor. 


Because peer groups allow the routing table to be checked only once, and allow updates to 
be replicated to all other in-sync peer group members (depending on the number of peer 
group members, the number of prefixes in the table, and the number of prefixes that are 
advertised), they can significantly reduce router resource requirements. 
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= Path MTU feature: All TCP sessions are bounded by a limit on the number of bytes that a 


single packet can transport. This limit, known as the Maximum Segment Size (MSS), is 
536 bytes by default. In other words, TCP breaks up packets in a transmit queue into 536- 
byte chunks before passing packets down to the IP layer. The advantage of a 536-byte MSS 
is that packets are not likely to be fragmented at an IP device along the path to the 
destination, because most links use an MTU of at least 1500 bytes. The disadvantage is that 
smaller packets increase the amount of bandwidth that is used to transport overhead. 


Because BGP builds a TCP connection to all peers, a 536-byte MSS affects BGP 
convergence times. The solution is to enable the PMTU feature by means of the ip tcp 
path-mtu-discovery command. You can use this feature to dynamically determine how 
large the MSS value can be without creating packets that need to be fragmented. PMTU 
allows TCP to determine the smallest MTU size among all links in a TCP session. TCP 
then uses this MTU value, minus room for the IP and TCP headers, as the MSS for the 
session. 


Increase interface input queues: If BGP is advertising thousands of routes to many 
neighbors, TCP must transmit thousands of packets. BGP peers receive these packets and 
send TCP acknowledgments (ACKs) to the advertising BGP speaker, causing the BGP 
speaker to receive a flood of TCP ACKs in a short period of time. If the ACKs arrive at a 
rate that is too high for the router CPU, packets back up in inbound interface queues. 


By default, router interfaces use an input queue size of 75 packets. In addition, special 
control packets such as BGP updates use a special queue with Selective Packet Discard 
(SPD). This special queue holds 100 packets. During BGP convergence, TCP ACKs can 
quickly fill the 175 spots of input buffering, causing newly arriving packets to be dropped. 
On routers with 15 or more BGP peers that also exchange the full Internet routing table, 
over 10,000 drops per interface per minute may be seen. Increasing the interface input 
queue depth using the hold-queue in command helps reduce the number of dropped TCP 
ACKs, thereby reducing the amount of work that BGP must do to converge. 
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Improving BGP Convergence (Cont.) 


BGP convergence can also be improved to 
some extent by: 


* Configuring a smaller interval for the BGP scanner 
process (scan time) 


° Configuring a smaller advertisement interval 
between BGP neighbors 
Limitation: 
* Not recommended in routers dealing with large 
BGP tables 
* Could lead to CPU or memory exhaustion 


Network administrators also need to improve BGP convergence in certain scenarios; for 
example, in networks using the conditional advertisement feature. There are two additional 
BGP parameters that they can use to influence BGP convergence speed: 


= Scan time: Controlling the BGP scanner process, responsible for verifying information in 
the BGP table 


m Advertisement interval: Controlling the rate at which successive advertisements are sent 
to a BGP neighbor 


Network administrators must take care when configuring these two parameters. Setting the 
values too low for a specific network environment could lead to a significant consumption of 
router resources. The larger the BGP tables and the more unstable the BGP network, the greater 
the danger of exhausting the resources of a router. 
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Path MTU Discovery 


This topic identifies the Cisco IOS commands that are required to configure and monitor 
PMTU discovery. 


Path MTU Discovery 


router (config) # 


ip tcp path-mtu-discovery [age-timer {minutes | infinite}] | 


* Enables the PMTU discovery feature for all new TCP 
connections from the router. 


° The age timer is a time interval for how often TCP re- 
estimates the path MTU with a larger MSS (default 
age timer is 10 min). 


¢ Feature is described in RFC 1191. 
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PMTU discovery is a method for maximizing the use of available bandwidth in the network 
between the endpoints of a TCP connection. It is described in RFC 1191. Existing connections 
are not affected when this feature is turned on or off. 


Customers using TCP connections to move bulk data between systems on distinct subnets 
would benefit most by enabling this feature. 


The age timer is a time interval for how often TCP re-estimates the PMTU with a larger MSS. 
The default value of the age timer is 10 min, but it can be manually configured up to 30 min or 
disabled (set to infinite). If the MSS that is used for the connection is smaller than what the peer 
connection can handle, the router will attempt to use a larger MSS each time that the age timer 
expires. The discovery process is stopped when either the sent MSS is as large as the peer 
negotiated, or the user has disabled the timer on the router. You can turn off the age timer by 
setting it to “infinite.” 


7-12 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


ip tcp path-mtu-discovery 


To enable the PMTU discovery feature for all new TCP connections from the router, use the ip 
tcp path-mtu-discovery global configuration command. 


= ip tcp path-mtu-discovery [age-timer {minutes | infinite} ] 


To disable the function, use the no form of this command. 


= no ip tcp path-mtu-discovery [age-timer {minutes | infinite} ] 


Syntax Description 


Parameter Description 


age-timer minutes (Optional) Time interval (in minutes) after which TCP re-estimates 
the PMTU with a larger MSS. The maximum interval is 30 min; 
the default is 10 min. 


age-timer infinite (Optional) Turns off the age timer. 
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Monitoring Path MTU Discovery 
———————— er en Sine coe 


router# show ip bgp 
Datagrams (max data 
Datagrams (max data 
Datagrams (max data 
Datagrams (max data 


neighbors 


segment 
segment 
segment 
segment 


is 
is 
is 
is 


| include max data 


536 bytes): 
536 bytes): 
536 bytes): 
536 bytes): 
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The default Maximum Segment Size (MSS) is 536 bytes. 


router# show ip bgp 
Datagrams (max data 
Datagrams (max data 
Datagrams (max data 
Datagrams (max data 


neighbors | 


segment 
segment 
segment 
segment 


is 
is 
is 
is 


include max 
1460 bytes): 
1460 bytes): 
1460 bytes): 
1460 bytes): 


data 
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After enabling of the path MTU discovery feature, the 
MSS has been increased. 
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By default, the MSS is 536 bytes. As shown in the figure, the show ip bgp neighbors | include 
max data command can be used to verify the size of the MSS before the PMTU discovery 


feature is enabled on the router. 


After using the ip tcp path-mtu-discovery command to enable PMTU discovery, the router 
dynamically determines how large the MSS can be without creating IP packets that require 
fragmentation. At the bottom of figure, the output shows that the PMTU feature has been 
enabled and the show ip bgp neighbors | include max data command has been used to 
determine that the PMTU discovery feature has set the MSS to 1460 bytes. 
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Increasing Input Queue Depth 


This topic identifies the Cisco IOS commands that are required to configure and monitor the 
input queue depth on a router interface. 


Increasing Input Queue Depth 


router (config-if) # 


hold-queue length in 


* Limits the size of the IP queue on an interface. 


° The default input hold-queue limit is 75 packets, 
configurable from 0 to 65,535 packets. 


° A length of 1000 will normally resolve problems 
caused by input queue drops of TCP ACKs. 
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Each interface owns an input queue onto which incoming packets are placed to await 
processing by the router. Frequently, the rate of incoming packets that are placed on the input 
queue exceeds the rate at which the router can process the packets. Each input queue has a size 
that indicates the maximum number of packets that may be placed in the queue. After the input 
queue becomes full, the interface drops any new incoming packets. 
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hold-queue 


7-16 


To specify the size of the IP input or output queue on an interface, use the hold-queue 
command in interface configuration mode. 


= hold-queue /ength {in | out} 


To restore the default values for an interface, use the no form of this command with the 
appropriate keyword. 


= no hold-queue length {in | out} 


Syntax Description 


Parameter 


length 


Description 


Integer that specifies the maximum number of packets in the 
queue. The range of allowed values is 0 to 65535. 


in 


Specifies the input queue. The default is 75 packets. For 
asynchronous interfaces, the default is 10 packets. These limits 
prevent a malfunctioning interface from consuming an excessive 
amount of memory. 


out 


Specifies the output queue. The default is 40 packets. For 
asynchronous interfaces, the default is 10 packets. These limits 
prevent a malfunctioning interface from consuming an excessive 
amount of memory. 


Caution 


Increasing the hold queue can have detrimental effects on network routing and response 
times. For protocols that use SEQ or ACK packets to determine round-trip times, do not 
increase the output queue. Dropping packets instead informs hosts to slow down 
transmissions to match available bandwidth. This approach is generally better than having 
duplicate copies of the same packet within the network (which can happen with large hold 
queues). 


Note The Cisco 12000 Series now uses a default SPD headroom value of 1000. It retains the 
default input queue size of 75. Use the show spd command to view these special input 
queues. 
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Monitoring Input Queue Depth 


router# show interfaces hssi 0/0/0 


Hssi0/0/0 is up, line protocol is up 
Hardware is cyBus HSSI 
Description: 45Mbps to R1 
Internet address is 200.200.14.250/30 
MTU 4470 bytes, BW 45045 Kbit, DLY 200 usec, rely 255/255, load 1/255 
Encapsulation HDLC, loopback not set, keepalive set (10 sec) 
Last input 00:00:02, output 00:00:03, output hang never 
Last clearing of "show interface" counters never 
Queueing strategy: fifo 
Packet Drop strategy: VIP-based weighted RED 
Output queue 0/40, 0 drops; input queue 0/75, O drops 
5 minute input rate 0 bits/sec, 0 packets/sec 
5 minute output rate O bits/sec, 0 packets/sec 
1976 packets input, 131263 bytes, O no buffer 
Received 1577 broadcasts, O runts, O giants O parity 
4 input errors, 4 CRC, 0 frame, O overrun, O ignored, O abort 
1939 packets output, 130910 bytes, O underruns 
0 output errors, O applique, 3 interface resets 
0 output buffers copied, O interrupts, 0 failures 
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In the figure, the show interface {interface-identifier} command displays the current input 
queue levels and the number of incoming packets dropped. 


The input queue x/y counter displays the current number of packets in the input queue x and the 
current size of the input queue y. The drops counter indicates the number of incoming packets 
that have been dropped. 


If the current number of packets in the input queue is consistently at or greater than 80 percent 
of the current size of the input queue, the size of the input queue may require tuning to 
accommodate the rate of incoming packets. Even if the current number of packets on the input 
queue never seems to approach the size of the input queue, bursts of packets may still be 
overflowing the queue. If the drops counter is increasing at a high rate, the size of the input 
queue may require tuning to accommodate the bursts. 


Copyright © 2004, Cisco Systems, Inc. Optimizing BGP Scalability 7-17 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


BGP Scan Time 


This topic identifies the Cisco IOS commands that are required to configure and monitor BGP 
scan time. 


BGP Scan Time 
en: nnn an CIScotcom aan =n 


router (config-router) # 


bgp scan-time scanner-interval 


* Changes the default value of BGP scanner process 
runs (default = 60 sec) 
* BGP scanner walks the BGP table and confirms the 


reachability of next hops 

* Also responsible for advanced features like 
conditional advertisement check and performing 
route dampening 
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Network administrators use the bgp scan-time command to configure the time interval for 
repetitions of the BGP scanner process. 


Recall that the BGP scanner process walks (scans) the BGP table and confirms the reachability 
of next hops. A change of this status will trigger a new BGP route selection for the network. 
Changes are then propagated by the router to established BGP neighbors. Increasing the BGP 
scanner process frequency will make the router find a changed status more quickly, but it will 
also consume more CPU resources. 


The BGP scanner process is also responsible for some advanced BGP features. It checks the 
conditional advertisement to determine whether or not BGP should advertise conditional 
prefixes or perform route dampening. 
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bgp scan-time 


To configure a nondefault value of the scanning interval for BGP routing information, use the 
bgp scan-time command. 


m= bgp scan-time [import] scanner-interval 


To disable the scanning interval of a router, use the no form of this command. 


= no bgp scan-time 


Syntax Description 


Parameter Description 


import (Optional) Configures import processing of Virtual Private 
Network version 4 (VPNv4) unicast routing information from BGP 
routers into routing tables. 


scanner-interval Specifies the scanning interval of BGP routing information. Valid 
values that are used for selecting the desired scanning interval 
are from 5 to 60 sec. By default, the scanning interval is 60 sec. 
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Monitoring BGP Scan Time 
nn ceed, 


router# show ip bgp summary 

BGP router identifier 172.16.0.4, local AS number 1 

BGP table version is 16, main routing table version 16 

11 network entries and 11 paths using 1463 bytes of memory 

8 BGP path attribute entries using 480 bytes of memory 

7 BGP AS-PATH entries using 168 bytes of memory 

3 BGP community entries using 72 bytes of memory 

0 BGP route-map cache entries using 0 bytes of memory 

3 BGP filter-list cache entries using 36 bytes of memory 

BGP activity 11/0 prefixes, 15/4 paths, scan interval 60 secs 


Neighbor Vv AS MsgRcvd MsgSent InQ OutQ Up/Down State/PfxRed 
172.16.0.1 4 30 
172.16.0.2 4 33 
172.16.0.3 4 27 
192.168.21.99 4 31 
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* Scan interval is defined per BGP router process and 
address family. 


* Checked with show ip bgp summary command. 
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You can check the configured BGP scan interval using the show ip bgp summary command. 


The configured BGP scan interval will apply to the entire BGP routing protocol process. 
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BGP Advertisement Interval 


This topic identifies the Cisco IOS commands that are required to configure and monitor the 
BGP advertisement interval. 


BGP Advertisement Interval 
—<—<— eee i ant CISCOICONT Pammay 


router (config-router) # 


neighbor {ip-address | peer-group-name} advertisement- 
interval seconds 


* Changes the default time interval in the sending of 
BGP routing updates for a specific neighbor: 


— If lowered, can improve convergence 
— Can consume considerable resources in a jittery 
network if the value is set too low 
¢ Default values: 
— 30 sec for EBGP neighbors 
— 5 sec for IBGP neighbors 
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With the help of the neighbor advertisement-interval command, network administrators can 
modify the default advertisement interval for a specific BGP peer. BGP advertisements are 
rate-limited by the router that is using the advertisement interval timer (defined as the 
parameter “MinRouteAdvertisementInterval” in RFC 1771). When a BGP-speaking router 
sends a route update to a neighbor for a specific destination, it is not allowed to send another 
update to the neighbor about the same destination until a period of time equal to the 
advertisement interval has elapsed. In that way, the advertisement interval timer acts as a form 
of rate limiting on a per-destination basis, even though the value of the advertisement interval is 
configured for each neighbor. 


It is important to note that during the time that the router is waiting for the advertisement 
interval timer to expire, the router can still receive and process route updates from BGP 
neighbors. Using the neighbor advertisement-interval command does not rate-limit BGP 
route selection (inbound updates and subsequent processing) but only the rate of outgoing route 
advertisements. 


When faster propagation of successive BGP updates (which are batched and rate-limited) is 
required, the network administrator can lower the default value of the advertisement interval, 
thus improving convergence. 


In routers that handle large BGP tables and less stable networks, lowering the advertisement 
interval could potentially lead to consuming large portions of router resources. 
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neighbor advertisement-interval 


To set the minimum interval in the sending of BGP routing updates, use the neighbor 
advertisement-interval router configuration command. 


m neighbor {ip-address | peer-group-name} advertisement-interval seconds 


To remove an entry, use the no form of this command. 


= no neighbor {ip-address | peer-group-name} advertisement-interval seconds 


Syntax Description 


Parameter Description 
ip-address Neighbor IP address. 
peer-group-name Name of a BGP peer group. If a BGP peer group is specified by 


using the peer-group-name argument, all members of the peer 
group will inherit the characteristic that is configured with this 
command. 


seconds Time in seconds. Integer from 0 to 600. The default is 30 sec for 
external peers and 5 sec for internal peers. 
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Monitoring the BGP 


Advertisement Interval 
EO (Cisco.com 


router# show ip bgp neighbors 192.168.21.99 

BGP neighbor is 192.168.21.99, remote AS 99, external link 
BGP version 4, remote router ID 10.0.0.3 
BGP state = Established, up for 00:43:35 

!....output omitted 
Default minimum time between advertisement runs is 30 seconds 


For address family: IPv4 Unicast 
BGP table version 24, neighbor version 24 
....output omitted 
Minimum time between advertisement runs is 15 seconds 


* Defined per BGP neighbor and address family 


* Manually configured minimum value stated under address 
family output of show ip bgp neighbors command 
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You can examine the currently configured BGP advertisement interval with the show ip bgp 
neighbors command. The advertisement interval is defined per a specific neighbor in a specific 
BGP address family. Actual values of the advertisement interval are therefore stated under the 
specific address family portion of the neighbor output. The default timer for EBGP is 30 sec. 
After the parameter was changed in the example here, the timer switched to 15 sec. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
ee Scone = | 


* Convergence is defined as the process of bringing 
all route tables to a consistent state. 


You can use the show process cpu | include BGP 
command to see the running BGP processes and the 
amount of CPU resources that they are consuming. 


The BGP scanner and BGP router processes can 
significantly impact the CPU utilization of the router, 
causing some low-priority processes to suffer 
increased processing delays. 


Increased BGP convergence time and high CPU 
utilization caused by the BGP scanner and BGP 
router processes can be reduced with Cisco lOS 
tools such as peer groups and path MTU discovery. 


Summary (Cont.) 


¢ The path MTU discovery feature finds the largest 
packet that can be sent to a destination without 
requiring IP fragmentation, minimizing packet 
overhead. 


Increasing the input queue depth is a technique that 
can eliminate dropped TCP ACKs, resulting in 
improved BGP convergence. 


Reducing the time between runs of the BGP scanner 
process improves BGP convergence at the cost of 
increased CPU resource consumption. 


You can reduce the advertisement interval, causing 
BGP updates to be sent to neighbors more quickly 
and resulting in improved BGP convergence time. 
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References 


For additional information, refer to these resources: 


m™ For more information on the Cisco IOS commands that are presented in this lesson, refer to 
“Cisco IOS IP and IP Routing Command Reference, Release 12.1” at the following URL: 
http://www.cisco.com/univercd/cc/td/doc/product/software/ios121/121cgcr/ip_r/index.htm 


m= For information on BGP convergence, refer to “An Analysis of BGP Convergence 
Properties,” by T. Griffin and G. T. Wilfong, SIGCOMM 1999 


m= For further information on BGP convergence, refer to “Improving BGP Convergence 
Through Consistency Assertions,” by Dan Pei, Xiaoliang Zhao, Lan Wang, Dan Massey, 
Allison Mankin, S. Felix Wu, and Lixia Zhang, 2002 
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Limiting the Number of 
Prefixes Received from a BGP 
Neighbor 


Overview 


BGP is designed for reliability and scalability. As such, it has a tremendous amount of 
flexibility regarding administrative policy controls, route selection, and performance tuning and 
scalability features. This lesson introduces an advanced BGP configuration tool that has been 
designed to improve BGP scalability and performance by reducing the number of prefixes that 
a router receives from a BGP neighbor. Discussed in this lesson is the need for prefix limiting 
and how to configure and monitor the maximum-prefix function. 


Relevance 


There are currently more than 110,000 prefixes on the Internet today. There are many 
circumstances where network administrators do not need or desire their routers to carry full 
Internet routing. Furthermore, there is a need to provide protective controls on customer-facing 
routers to ensure that a configuration error does not cause the accidental advertisement of 
prefixes from autonomous systems that did not originate them. 


Objectives 


Upon completing this lesson, you will be able to reduce the number of prefixes that are 
received from a BGP neighbor. This includes being able to meet these objectives: 


m Describe the need for limiting the number of routes that are received from a BGP neighbor 


m Identify the Cisco IOS command that is required to configure the BGP maximum-prefix 
function 


m Identify the Cisco IOS command that is required to monitor the BGP maximum-prefix 
function 
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Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
— i rc] 


° Overview 


¢ Limiting the Number of Routes Received from 
a Neighbor 


¢ Configuring the BGP Maximum-Prefix 
Function 


¢ Monitoring the BGP Maximum-Prefix Function 


° Summary 
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Limiting the Number of Routes Received from a 
Neighbor 


This topic describes the need for limiting the number of routes (prefixes) that are received from 
a BGP neighbor. 


Limiting the Number of Routes Received 


from a Neighbor 
EN (0 


Definition of problem: 


° All other filtering mechanisms specify only what 
you are willing to accept but not how much 


* A misconfigured BGP neighbor can send a huge 


number of prefixes that can exhaust the memory of 
a router or overload the CPU (several Internet-wide 
incidents have already occurred) 


* Anew tool is needed to establish a hard limit on 
the number of prefixes received from a neighbor 
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Incoming filters and route-maps indicate what BGP attribute values that a route should have in 
order to be accepted. Route filters can be applied that match routes that are based on the 
network number or the BGP attributes that are attached to a route. The most commonly applied 
filter is one that matches the contents of the AS-path attribute. 


An Internet service provider (ISP) with a multihomed customer may use filters to ensure that 
the routes that are received from the customer originate within the autonomous system (AS) of 
the customer. Using an AS-path access-list is one method of achieving this goal. 


An improperly configured filter in a customer router may accidentally cause a large number of 
Internet routes to be received by the customer. Even worse, a faulty configuration may cause 
prefixes to be advertised by the customer as if the routes originated inside the customer AS. 
This situation would result in a BGP table, in the ISP router, that lists many of the possible 
destination networks on the Internet as reachable in the customer AS (with the AS path 
containing only a single entry, the customer AS). The BGP route selection in the ISP network 
would select those routes as the best (based on the AS-path length) and direct much of the 
provider traffic intended for the Internet to the customer network. 


An AS-path filter in the ISP router would not prevent this accident. The routes that are sent by 
the customer have the anticipated AS-path value. A prefix-list that distinctly identifies and 
permits each of the network numbers that the customer may advertise would have prevented the 
accident. But such a prefix-list is hard to maintain. 
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A more scalable solution is to use a new tool, which limits the number of routes that are 
received from a specific neighbor. 


7-30 Configuring BGP on Cisco Routers (BGP) v3.1 Copyright © 2004, Cisco Systems, Inc. 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


Configuring the BGP Maximum-Prefix Function 


This topic presents the Cisco IOS command that is used to configure the maximum-prefix 
function in BGP. 


Configuring the BGP 
Maximum-Prefix Function 


router (config-router) # 


neighbor ip-address maximum-prefix maximum [threshold] 
[warning-only] [restart restart-interval] 


° Controls how many prefixes can be received from a 
neighbor. 


Optional threshold parameter specifies the percentage 
where a warning message is logged (default is 75%). 


Optional warning-only keyword specifies the action on 
exceeding the maximum number (default is to drop 
neighbor relationship). 


Optional restart keyword instructs the router to try to re- 
establish the session after the specified interval in 
minutes. 


BGP v3.1—7-4 
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neighbor maximum-prefix 


7-32 


To control how many prefixes that a BGP router can receive from a neighbor, use the neighbor 
maximum-prefix router configuration command. 


= neighbor {ip-address | peer-group-name} maximum-prefix maximum [threshold] 
[warning-only] [restart restart-interval] 


To disable this function, use the no form of this command. 


= no neighbor {ip-address | peer-group-name} maximum-prefix maximum 


Syntax Description 


Parameter Description 

ip-address IP address of the neighbor. 

peer-group-name Name of a BGP peer group. 

maximum Maximum number of prefixes that are allowed from this neighbor. 
threshold (Optional) Integer specifying at what percentage of maximum the 


router starts to generate a warning message. The range is 1 to 
100 percent; the default is 75 percent. 


warning-only (Optional) Allows the router to generate a log message when the 
maximum is exceeded, instead of terminating the peering. 


restart (Optional) Configures the router to automatically re-establish a 
peering session that has been disabled because the maximum- 
prefix limit has been exceeded. The configurable range of the 
restart interval is from 1 to 65,535 min. 


This command allows you to configure a maximum number of prefixes that a BGP router is 
allowed to receive from a peer. It adds another mechanism (in addition to distribute-lists, filter- 
lists, and route-maps) to control prefixes that are received from a peer. 


When the number of received prefixes exceeds the maximum number that is configured, the 
router terminates the peering (by default). However, if the warning-only keyword is 
configured, the router sends only a log message but continues peering with the sender. If the 
peer is terminated, the peer session will remain down until the clear ip bgp command is issued 
on the router, unless you have included the restart keyword in the configuration. 


Note You can use the bgp dampening command to configure the dampening of a flapping route 
or interface when a peer is sending too many prefixes and causing network instability. You 
should need the restart command only when you are troubleshooting or tuning a router that 
is sending an excessive number of prefixes. 
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Monitoring the BGP Maximum-Prefix Function 


This topic presents the Cisco IOS command that is used to monitor the operation of the 
maximum-prefix function in BGP. 


Monitoring the BGP 


Maximum-Prefix Function 
——— ee emt CISCOICONT Cammed 


router> 


show ip bgp neighbors [address] 


° For neighbors with the maximum-prefix function 
configured, displays the maximum number of 


prefixes and the warning threshold 


¢ For neighbors exceeding the maximum number 
of prefixes, displays the reason that the BGP 
session is idle 
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Network administrators use the show ip bgp neighbors command to monitor the status of BGP 
neighbors. Among other things, the command displays information about how many prefixes 
that a BGP router has received from a neighbor and if any limits have been configured. 
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Example 


Monitoring the BGP 


Maximum-Prefix Function (Cont) 


RTR-B# show ip bgp neighbors 1.3.0.3 
BGP neighbor is 1.3.0.3, remote AS 387, external link 

Index 2, Offset 0, Mask 0x4 

Community attribute sent to this neighbor 

BGP version 4, remote router ID 14.1.2.3 

BGP state = Established, table version = 6, up for 20:55:10 

Last read 00:00:08, hold time is 180, keepalive is 60 seconds 

Minimum time between advertisement runs is 30 seconds 

Received 1262 messages, 0 notifications, 0 in queue 

Sent 1262 messages, 0 notifications, 0 in queue 

Inbound path policy configured 

Outbound path policy configured 

Route map for incoming advertisements is LocPref 

Route map for outgoing advertisements is BackupComm 

Connections established 1; dropped 0 

Last reset never 

No. of prefix received 2, maximum limit 5 

Threshold for warning message 70% 
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In this example, the neighbor with IP address 1.3.0.3 has been configured with a prefix limit of 
five prefixes. Currently, the BGP router has received two prefixes, which is under the limit. The 
threshold for the warning message is set to 70 percent, meaning that after receiving four 
prefixes from the 1.3.0.3 neighbor, the BGP router will generate a warning message. 
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Monitoring the BGP 


Maximum-Prefix Function cont) 


RTR-B# 
%SBGP-4-MAXPFX: No. of prefix received from 1.3.0.3 reaches 4, max 5 
%BGP-3-MAXPFXEXCEED: No. of prefix received from 1.3.0.3: 6 exceed limit 5 


RTR-B# show ip bgp sum 

BGP table version is 22, main routing table version 22 

9 network entries (9/27 paths) using 1920 bytes of memory 
5 BGP path attribute entries using 572 bytes of memory 

0 BGP route-map cache entries using 0 bytes of memory 

0 BGP filter-list cache entries using 0 bytes of memory 


Neighbor Vv AS MsgRcvd MsgSent Tblver InQ OutQ Up/Down State/PfxRed 
8 


1.0.0.1 
1.3.0.3 


4 213 1269 1268 22 ie) 0 21:02:19 

4 387 1272 1274 0 0 0 00:00:08 Idle 
RTR-B# show ip bgp neighbor 1.3.0.3 

BGP neighbor is 1.3.0.3, remote AS 387, external link 


Last reset 00:00:18, due to : Peer exceeding maximum prefix limit 
Peer had exceeded the max. no. of prefixes configured. 

Reduce the no. of prefix and clear ip bgp 1.3.0.3 to restore peering 
No active TCP connection 
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The logging outputs, in the example here, show that a BGP neighbor is close to exceeding the 
configured maximum-prefix limit. The total number of received prefixes has reached four, 
which is over the threshold to generate a warning message. The warning is displayed on the 
console and optionally sent to a syslog server. 


The logging output then shows that two more prefixes have been received. The total number is 
now six, which is above the configured limit. The BGP session is therefore terminated. The 
output of the show ip bgp neighbors command shows that the reason for resetting the session 
is that the peer exceeded the configured maximum number of prefixes. As a result of the 
session being reset, the BGP session will remain in the Idle state. 


To force the neighbor from the Idle state into the Active state and to re-establish the BGP 
session, the network administrator must issue the clear ip bgp ip-address command for the 
neighbor (except if the network administrator has specified the restart keyword in the 
configuration, in which case the router tries to re-establish the BGP session automatically after 
the expiration of the configured restart timeout interval). 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
isc cor 


¢ The maximum-prefix function is a scalable solution 
that limits the number of routes that a BGP router can 
receive from a specific neighbor. 


The neighbor maximum-prefix command allows you to 
configure a maximum number of prefixes that a BGP 
router is allowed to receive from a peer. 


When the number of received prefixes exceeds the 
maximum number configured, the router terminates 
the peering (by default). If the warning-only keyword 
is configured, the router sends only a log message 
but continues peering with the sender. 


You can use the show ip bgp neighbors command to 
monitor the maximum-prefix function. 


References 


For additional information, refer to this resource: 


= For more information on the neighbor maximum-prefix command and its function, refer 
to “BGP Restart Session After Maximum-Prefix Limit” at the following URL: 
http://www.cisco.com/univercd/cc/td/doc/product/software/ios120/120newft/120limit/120s/ 
120s22/sbgprsmp.htm 


Next Steps 
For the associated lab exercise, refer to the following section of the course Lab Guide: 


m Lab Exercise 7-1: Limiting the Number of Prefixes Received from a BGP Neighbor 
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Implementing BGP Peer 
Groups 


Overview 


Typical service provider networks usually contain BGP-speaking routers that consist of many 
neighbors that are configured with the same administrative policies (such as outbound route- 
maps, distribute-lists, filter-lists, update source, and so on). Network administrators can group 
together neighbors with the same update policies into peer groups to simplify configuration 
and, more importantly, to make BGP updates more efficient. 


As a result of using peer groups, the same update packets can be sent from a router to each 
group member, resulting in a reduction in the number of CPU cycles that BGP requires to 
advertise routes to peers. This lesson introduces peer groups as a BGP scalability mechanism. 
The lesson also discusses the commands that are required to properly configure and monitor 
BGP peer groups. 


Relevance 


Scaling routers to meet the demands of full Internet routing and associated administrative 
policies requires protocols like BGP with embedded scalability mechanisms. In environments 
where network administrators must configure a large number of BGP peers, peer groups are a 
scalability tool that reduces both administrative overhead and router resource requirements. The 
major benefit of specifying a BGP peer group is that it reduces the amount of system resources 
(CPU and memory) that are used in the generation of an update. It also simplifies BGP 
configuration because it allows the routing table to be checked only once and updates to be 
replicated to all other in-sync peer group members. 
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Objectives 


Upon completing this lesson, you will be able to describe the use of BGP peer groups. This 
includes being able to meet these objectives: 


m Describe the need for BGP peer groups 

m™ Describe the performance benefits of using BGP peer groups 

m™ Describe the limitations of BGP peer groups 

m Describe the implementation of BGP peer groups in Cisco IOS software 

m™ Identify the Cisco IOS commands that are required to configure BGP peer groups 


m Identify the Cisco IOS commands that are required to monitor the operation of BGP peer 
groups 
Learner Skills and Knowledge 


To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 

° Overview 

° Peer Group Requirements 

¢ Peer Groups as a BGP Performance Tool 
° BGP Peer Group Limitations 

° BGP Peer Groups in Cisco IOS Software 
¢ Configuring Peer Groups 


¢ Monitoring Peer Groups 


° Summary 
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Peer Group Requirements 


This topic describes the need for BGP peer groups and provides three examples of where 
network administrators can use peer groups in service provider networks. 


Peer Group Requirements 


¢ BGP routers could have a large number of 
neighbors with similar requirements: 


— Provider edge router with many customer 
connections 


— BGP route reflector with many IBGP peers 
— Provider edge router at an exchange point 


° Most of the parameters specified for the BGP 
neighbors are identical, with a few exceptions. 


BGP v3.1—7-3 


In many cases, a network administrator must configure a single router with a large number of 
neighbors, each neighbor having similar parameters as the others. This situation may cause 
time-consuming configuration work, because the network administrator has to configure almost 
the same filter-list, route-map, and prefix-list for all of the neighbors. A service provider 
network with an edge router having a large number of customers attached to it, where each 
customer requires its own BGP session, may find that all of the BGP sessions to its customer 
routers have almost identical configurations. 


Likewise, Internal Border Gateway Protocol (IBGP) sessions are almost always identically 
configured. If a full mesh is deployed within an AS, a large number of peer configurations 
might exist. Recall that an AS containing only 15 routers will require ([15 * 14]/ 2) = 105 
neighbor sessions to meet the full-mesh requirement of BGP. Configuring 105 neighbors with 
duplicate parameters leads to a tremendous amount of redundant configuration. 


To ease the burden of configuring a large number of neighbors with identical or similar 
parameters (for example, route-maps, filter-lists, or prefix-lists), the concept of peer groups was 
introduced. The network administrator can configure a template, or peer group. The 
administrator configures the peer group with all the BGP parameters that are to be applied to 
many BGP peers. Actual BGP neighbors are bound to the peer group, and the network 
administrator applies the peer group configuration on each of the BGP sessions. BGP neighbors 
of a single router can be divided into several groups, each group having its own BGP 
parameters. Actual neighbors are then bound to the appropriate group, resulting in an optimum 
BGP configuration. 
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Example 


7-40 


Peer Group Requirements Example: 
Customer Connections 


Customer AS Provider Edge Router 


Customer AS 


Service Provider AS 


Customer AS Common Parameters: 


« Incoming and outgoing route-maps 
« Incoming and outgoing filter-lists 
«= Maximum number of accepted prefixes 
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In a service provider network, a group of customer autonomous systems can be treated in the 
same (or a very similar) way. They are all assumed to announce local networks only. All 
customer autonomous systems should receive BGP updates with the same set of Internet routes, 
and they are all assumed to generate only a small number of prefixes. 


This situation makes the neighbor configuration almost identical for each of the customers, 
with only a few changes that are specific to each neighbor. 


In this scenario, the use of the peer group function is highly desirable. The network 
administrator can configure BGP neighbors in the customer autonomous systems using a single 
peer group. The administrator configures the peer group template with references to route- 
maps, filter-lists, prefix-lists, and the maximum number of received prefixes. Then the IP 
addresses of the customer routers are bound to the peer group, and the peer group configuration 
is applied to all of them. 
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Example 


Peer Group Requirements Example: 


BGP Route Reflector 
—— ee Cisco'co Tn | 


Route Reflector 


Service Provider AS 


Common Parameters: 


» Autonomous system 

» Propagation of communities 
» Source interface 

= MD5 password 


002G_270 
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In order to apply a consistent routing policy within the entire local AS, the network 
administrator needs to configure each and every IBGP session identically. If a router in the AS 
is supplied with some information, then all the routers should be supplied with the same 
information. Otherwise, an inconsistent routing policy within the AS might cause inconsistent 
routing or application of BGP policies. 


The peer group function is a good tool to make sure that all IBGP peers receive the same 
configuration information. The network administrator configures a peer group template with 
the required parameters, such as the neighbor AS number, enabling of the send-community 
option, setting of the update source to a loopback interface, and router authentication 
mechanisms. Then all the internal neighbor IP addresses are bound to the peer group, and the 
peer group configuration is applied to all of them. This approach ensures a consistent routing 
policy within the AS. 


In a service provider network, the routers that are assigned as route reflectors are the routers 
with the largest number of IBGP sessions. These are the routers where the peer group function 
is most useful. 
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Example 


Peer Group Requirements Example: 
Edge Router at a Peering Point 


Peering AS 


Edge router at 
a peering point 


Service Provider AS 


Common Parameters: 


= Incoming and outgoing route-maps 

= Incoming and outgoing filter-lists 

= Maximum number of accepted prefixes 
= Removal of private AS numbers 


The edge router that is located in the network where the service provider exchanges routes with 
other service providers is also a suitable place to use peer groups. From the edge router, the 
service provider AS can peer with a large number of other service providers. 


All peering autonomous systems should receive the same set of routes, namely the routes local 
to the service provider AS and the routes that are received from customer autonomous systems. 
Also, all routes that are received by the service provider peering router from all peering 
autonomous systems are processed almost identically. The characteristic of the exchange 
network is the same regardless of which neighbor the routes are received from. If the peering 
point is an FDDI, ATM, Gigabit Ethernet, or Dynamic Packet Transport (DPT) network, the 
preference of using the network for packet exchange may be different. However, for each 
single peering point, all neighbors are reachable over the same network, and the preference is 
quite likely to be the same. 


Additionally, a number of other parameters could be the same, such as the removal of private 
AS numbers and limiting the number of routes received. In these cases, the network 
administrator can apply these parameters on the peer group template before the actual IP 
addresses of the neighbors are bound to the peer group. 
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Peer Groups as a BGP Performance Tool 


This topic describes the performance benefits of using BGP peer groups. 


Peer Groups as a BGP 
Performance Tool 


¢ Cisco IOS software builds individual BGP 
updates for each BGP neighbor. 


— The CPU load imposed by the BGP process is 
proportional to the number of BGP neighbors. 


° A single BGP update is built for all members of 


a BGP peer group. 


— The CPU load does not increase linearly with the 
increased number of neighbors. 


— Hint: Use peer groups wherever possible to reduce 
the CPU load of the BGP process. 


By default, Cisco IOS software builds BGP updates for each neighbor individually. Building 
BGP updates involves a number of router-CPU-consuming tasks, including scanning the BGP 
table and applying a variety of outgoing filtering mechanisms (filter-lists, route-maps, and 
prefix-lists). These tasks imply that when a router is configured with a large number of 
neighbors, the CPU load grows proportionally. 


However, with the use of peer groups, some of the router CPU utilization that is imposed by 
BGP update generation is significantly reduced, because the use of peer groups allows the 
router to run the BGP update (including all outgoing filter processing) only once for the entire 
peer group. The router, after it has finished building the BGP update, sends it to each member 
of the peer group. The actual TCP transmission still has to be done on a per-neighbor basis 
because of the connection-oriented characteristics of BGP sessions. 


So, router CPU load does increase when there are more neighbors of a router, because of 
increased TCP workload, but the use of peer groups can significantly reduce the increase. 
Therefore, network administrators should use peer groups whenever possible to reduce the CPU 
load. 


Note BGP peer groups are the fundamental BGP scalability tool and should be used in all 
environments where a router has a large number of BGP neighbors. 


Copyright © 2004, Cisco Systems, Inc. Optimizing BGP Scalability 7-43 
The PDF files and any printed representation for this material are the property of Cisco Systems, Inc., 
for the sole use by Cisco employees for personal study. The files or printed representations may not be 
used in commercial training, and may not be distributed for purposes other than individual self-study. 


BGP Peer Group Limitations 


This topic describes the limitations of BGP peer groups. 


BGP Peer Group Limitations 


¢ Peer groups have a number of limitations 
because of the way that they are used to build 
BGP updates. 


— Per-neighbor BGP parameters that affect 
outbound updates cannot be changed for peer 
group members. 


— IBGP and EBGP neighbors cannot be mixed ina 
peer group. 


Because the router builds only one update for all members of the same peer group, some 
restrictions apply to members of the peer group: 


m There cannot be different outbound filters, route-maps, or other means that could possibly 
cause different updates to be sent to two members of the same peer group. Cisco IOS 
software creates only one update, which is subsequently replicated to all members. Any 
violation of this rule could cause unexpected results. 


m= EBGP and IBGP updates are very different. EBGP updates have the AS-path attribute 
changed. IBGP sessions pass only the local preference attribute. The multi-exit 
discriminator (MED) attribute that is received from a remote AS is passed on to IBGP 
sessions but is removed before it is sent on an EBGP session. Therefore, you cannot assign 
IBGP neighbors and EBGP neighbors to the same peer group because they cannot receive a 
replicate of the same update. 


Prior to Cisco IOS Release 11.1(18)CC, a route reflector client could not be a member of a peer 
group. When the peer group leader was a route reflector client and an update was received from 
it, the route reflector split-horizon rules prevented the update from being sent back to the 
sender. Therefore, no update was generated for any members of the peer group. When using 
peer groups in combination with route reflectors, make sure that all routers in the AS are 
running Cisco IOS releases later than 11.1(18)CC, where this restriction is lifted. 
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Because the router sends the same update to each of the peer group members, the next-hop 
BGP attribute is replicated. The receivers of the information must be able to use the same next- 
hop IP address, requiring the receivers to be in the same IP subnet. If two receivers are on 
different subnets, only one of them will receive a valid next-hop attribute. The other routers 
will receive a next-hop IP address that is inaccessible. This restriction was also removed in 
Cisco IOS Release 11.1(18)CC, making BGP peer groups an ideal scalability tool. 
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BGP Peer Groups in Cisco IOS Software 


This topic describes the characteristics of BGP peer groups when they are implemented in 
Cisco IOS software. 


BGP Peer Groups in 
Cisco IOS Software 


* BGP peer group creates a neighbor parameter 
template. 
* Configurable parameters include: 
— Community propagation 
— Source interface for TCP session 
— EBGP multihop sessions 
— MD5 password 
— Neighbor weight 
— Filter-lists and distribute-lists 
— Route-maps 
° Individual parameters specified in a peer group 


can be overridden on a neighbor-by-neighbor 
basis. 
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On a Cisco IOS router, the peer group is created as a template. The template is configured to: 
m Propagate, or not propagate, the community attribute 


m Use the IP address of a specific interface as the source address when opening the TCP 
session 


m Use, or not use, the EBGP multihop function 
m Use, or not use, Message Digest 5 (MD5) authentication on the BGP sessions 
= Assign a particular weight value to the routes that are received 


m Filter out any incoming or outgoing routes based on the content of the AS-path attribute 
that are associated with the route or the network number of the route 


m Pass the incoming or outgoing routes through a particular route-map 


When actual neighboring routers are assigned to the peer group on a router, all of the attributes 
that are configured for the peer group are applied to all peer group members. Cisco IOS 
software optimizes the outgoing routes by running through the outgoing filters and route-maps 
only once and then replicating the results to each of the peer group members. In reality, Cisco 
IOS software assigns a peer group leader, for which the software generates an update, and this 
update is replicated by the leader to all other members of the peer group. 


Some parameters configured on the peer group can be overridden by neighbor configurations, 
but only if the individual configurations apply on incoming updates. Outgoing updates are 
always prepared for the peer group leader and then replicated to the other members of the peer 


group. 
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Configuring Peer Groups 


This topic identifies the commands that are to configure BGP peer groups on Cisco IOS 
routers. 


Configuring Peer Groups 


router (config-router) # 


neighbor group-name peer-group 


* Creates a BGP peer group 
* Peer group names are case-sensitive 


router (config-router) # 


neighbor group-name any-BGP-parameter 


¢ Specifies any BGP parameter for the peer group 
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To configure BGP peer groups on Cisco IOS routers, perform the following steps: 
m Create a BGP peer group 

m Specify parameters for the BGP peer group 

m Create a BGP neighbor 


m Assign a neighbor into the peer group 


neighbor peer-group (creating) 
To create a BGP peer group, use the neighbor peer-group router configuration command. 


m neighbor peer-group-name peer-group 


To remove the peer group and all of its members, use the no form of this command. 


= no neighbor peer-group-name peer-group 


After you have created a peer group using the neighbor peer-group command, you can 
configure it with the neighbor commands. By default, members of the peer group inherit all the 
configuration options of the peer group. You can also configure members to override the 
options that do not affect outbound updates. 


Peer group members will always inherit the following configuration options: remote-as (if 
configured), version, update-source, out-route-map, out-filter-list, out-dist-list, minimum- 
advertisement-interval, and next-hop-self. All peer group members will inherit changes that 
are made to the peer group. 
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Configuring Peer Groups (Cont.) 


router (config-router) # 


neighbor ip-address peer-group peer-group-name 


* Assigns a BGP neighbor into a peer group. 


° The neighbor inherits all the BGP parameters 
specified for the peer group. 


router (config-router) # 


neighbor ip-address any-BGP-parameter 


* Overrides a BGP parameter specified for the peer 
group with a neighbor-specific parameter. 


neighbor peer-group (assigning members) 


To configure a BGP neighbor to be a member of a peer group, use the neighbor peer-group 
router configuration command. 


m neighbor ip-address peer-group peer-group-name 

To remove the neighbor from the peer group, use the no form of this command. 
= no neighbor ip-address peer-group peer-group-name 

Syntax Description 


Parameter Description 


ip-address IP address of the BGP neighbor that belongs to the peer group 
that is specified by the tag 


peer-group-name Name of the BGP peer group to which this neighbor belongs 


After you have assigned an actual neighbor to be a member of the peer group, all configurations 
made to the peer group template are then applied to all the neighbors that are assigned to that 
peer group. 


Through configuration, peer group configurations may be overridden on an individual neighbor 
basis provided that the changes apply only to incoming updates. Remember that outgoing 
updates are prepared only once and then replicated. 
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Example 


BGP Peer Group Example: 
Customer Connections 


Provider 
Edge Router 


router bgp 123 
neighbor Customers peer-group 
neighbor Customers route-map Cust In in 
neighbor Customers route-map Cust _Out out 
neighbor Customers filter-list 10 in 
neighbor Customers maximum-prefix 50 


neighbor 1.2.3.4 remote-as 213 
neighbor 1.2.3.4 peer-group Customers 
neighbor 2.3.4.5 remote-as 314 
neighbor 2.3.4.5 peer-group Customers 
neighbor 2.3.4.5 filter-list 21 in 


Override a peer 
Thee parameter 
ra single neighbor 
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In this example, the router in AS 123 is being configured with a peer group named 
“Customers.” This peer group is used for all customers of the service provider because they 
share an almost identical routing policy. The peer group is first created as a template, which is 
configured with an incoming route-map named “Cust_In” and an outgoing route-map named 
“Cust_Out,” as well as an incoming AS-path filter-list number of 10. The peer group is also 
configured with a maximum limit of 50 received prefixes. 


Then neighbors in AS 213 and AS 314 are assigned to the peer group. These additions mean 
that the router in AS 123 will attempt to open BGP sessions with those routers. If the BGP 
sessions succeed, the route-maps Cust_In and Cust_Out will be used with both neighbors on 
incoming and outgoing routes, respectively. The maximum number of received prefixes that 
can configured in the “Customer” peer group will also be applied to both neighbors. 


Filter-list 10 will be used to filter out any incoming routes from peer group members unless 
otherwise specified. However, in the case of the neighbor in AS 314, the individual 
configuration of filter-list 21 will override the peer group configuration, and the AS-path 
access-list number 21 will be used instead. 


The peer group is a very powerful tool when network administrators are dealing with a large 
number of neighbors with almost identical configurations. However, if any of the customers 
require routing information that differs from what other members of the “Customer” peer group 
receive, then that neighbor must be removed from the peer group and configured as an 
individual neighbor. This would be the situation for not including AS 337 neighbor into peer 
group “Customer.” 
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Example 


BGP Peer Group Example: 


BGP Route Reflector 
EY ——CO SET] 


Route Reflector 


Neighbor AS-number 


rouber pops tes defined in the peer-group 


neighbor IBGP peers peer-group 

neighbor IBGP_peers remote-as 123 

neighbor IBGP peers update-source loopback 0 
neighbor IBGP_peers password c73Dx8K 
neighbor IBGP_peers send-community 


neighbor 10.0.1.3 peer-group IBGP_peers 
neighbor 10.0.1.4 peer-group IBGP_peers 
neighbor 10.0.1.6 peer-group IBGP_peers 
neighbor 10.0.1.8 peer-group IBGP_peers 
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In a large AS, some routers may have a large number of IBGP sessions. In this example, a 
router acting as a BGP route reflector has four IBGP neighbors. A peer group that is named 
“IBGP_peers” is created to handle all of the IBGP sessions. The peer group is created and 
configured with the remote AS, update-source, MD5 authentication, and community passing 
parameters. When the actual neighbors are configured as members of the peer group, all these 
configuration parameters will apply to all of the neighbors. 


In the case of IBGP, the remote AS can also be configured as a part of the peer group 
configuration because the AS number is the same for each of the peer group members. 


The peer group is a very powerful tool when you are dealing with a large number of IBGP 
neighbors because you can give all of the neighbors the same configuration to ensure a 
consistent AS-wide routing policy. 
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Example 


BGP Peer Group Example: 


Edge Router at a Peering Point 
Dn S/S 0 


Edge router at 
a peering point 


router bgp 123 
neighbor Peering peer-group 
neighbor Peering filter-list 10 in 
neighbor Peering route-map PeerMap out 
neighbor Peering maximum-prefix 50 
neighbor Peering remove-private-AS 


neighbor 1.2.3.4 remote-as 745 
neighbor 1.2.3.4 peer-group Peering 
neighbor 2.3.4.5 remote-as 837 
neighbor 2.3.4.5 peer-group Peering 
no neighbor 2.3.4.5 maximum-prefix 50 
no neighbor 2.3.4.5 filter-list 10 in 
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In this example, the router in AS 123 is being configured with a peer group named “Peering.” 
This peer group is used for all peer providers because they share an almost identical routing 
policy. The peer group is first created as a template, which is configured with an incoming AS- 
path filter-list (list 10) and an outgoing route-map named “PeerMap.” The maximum number of 
received prefixes is also set in the peer group to 50. The peer group has also been configured to 
remove private AS numbers (AS numbers in the range 64512 to 65535 inclusive) from all AS 
paths before the routes are sent to the peer AS. 


The neighbors in AS 745 and in AS 837 are then assigned to the peer group, meaning that the 
router in AS 123 will attempt to open BGP sessions with those routers. If the BGP sessions are 
successfully established, filter-list 10 and the route-map PeerMap, as configured in the peer 
group, will be applied to incoming and outgoing routes from both neighbors, respectively. 


As defined in the router configuration, filter-list 10 filters out any incoming routes from peer 
group members unless otherwise specified. However, in the case of the neighbor in AS 837, the 
individual configuration of no filter-list 10 will override the peer group configuration, and 
thus, the filter-list will not be used for this neighbor. The limitation on the number of received 
routes from AS 837 is also removed from the neighbor in AS 837. 


The peer group is a very powerful tool when you are dealing with a large number of neighbors 
with almost identical configurations. However, if any of the customers that are assigned to the 
peer group require routing information that is different from other members of the peer group, 
then that neighbor must be removed from the peer group and configured individually. 
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Monitoring Peer Groups 


This topic lists the Cisco IOS commands that are required to monitor BGP peer groups. 


Monitoring Peer Groups 


ee ee Cena = | 


router> 

show ip bgp peer-group [peer-group-name] 

° Displays the definition of the specified peer group or 
all peer groups 


router> 


show ip bgp peer-group [peer-group-name] summary 


* Displays summary status of all neighbors in the peer 
group 


router# 


clear ip bgp [peer-group-name] [[soft] in|out] 


¢ Clears BGP session with all peer group members 
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show ip bgp peer-group 


To display information about BGP peer groups, use the show ip bgp peer-group EXEC 
command. 


= show ip bgp peer-group [peer-group-name] summary 


Syntax Description 


Parameter Description 

peer-group-name (Optional) Displays information about that specific peer group 

summary (Optional) Displays a summary of the status of all the members of 
a peer group 
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clear ip bgp 


To reset the BGP sessions with all the members of a peer group, use the clear ip bgp EXEC 


command. 


= clear ip bgp {* | neighbor-address | peer-group-name} [soft [in | out]] 


Syntax Description 


Parameter 


* 


Description 


Resets all current BGP sessions. 


neighbor-address 


Resets only the identified BGP neighbor. 


peer-group-name 


(Optional) Displays information about that specific peer group 


soft 


(Optional) Soft reconfiguration. 


in | out 


(Optional) Triggers inbound or outbound soft reconfiguration. If 
you do not specify the in or out option, both inbound and 
outbound soft reconfiguration are triggered. 
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Monitoring Peer Groups (Cont.) 


Neighbor that is used to compute 
BGP updates for the whole group 


router# show ip bgp peer-group 


Peer-group contains EBGP peers 


BGP neighbor is wg_peers, peer-group leader 
192.168.20.1, external 
Description: Workgroup neighbors reachable over 
provider LAN 
Index 2, Offset 0, Mask 0x4 
BGP version 4 
Minimum time between advertisement runs is 5 seconds 
Incoming update network filter list is 6 
Outgoing update network filter list is 6 
Incoming update AS path weight,filter list 25, 


weight 200 


Incoming update AS path filter list is 27 


002G_275 


Peer-group parameters 
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In this example, the show ip bgp peer-group command displays information about the peer 
group named “wg_peers.” One of the peer group members (192.168.20.1) has been selected as 
the peer group leader, meaning that all outgoing BGP updates are processed as if they were 
being sent to this neighbor. Thereafter, the update is replicated on all the BGP sessions to the 
other members in the wg_peers peer group. 


A peer group should have only IBGP members or EBGP members. In the example above, the 
members are EBGP neighbors. 


All parameters that are configured for the peer group are listed in the show ip bgp peer-group 
command output. In the example, the peer group wg_peers has been configured in the 


following manner: 


neighbor 


wg_ peers 


over provider LAN 


neighbor 
neighbor 
neighbor 
neighbor 


wg_ peers 
wg peers 
wg peers 
wg_ peers 
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description Workgroup neighbors reachable 


distribute-list 6 in 
distribute-list 6 out 
filter-list 25 weight 200 
filter-list 27 in 
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router# show ip bgp peer-group wg peers summary 

BGP table version is 56, main routing table version 56 

51 network entries (51/153 paths) using 10568 bytes of memory 
18 BGP path attribute entries using 2296 bytes of memory 

0 BGP route-map cache entries using 0 bytes of memory 

0 BGP filter-list cache entries using 0 bytes of memory 


AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State 
ak 0 0 0 0 0 never Active 
2 0 0 never Active 

0 never Active 

0 00:00:52 

0 

0 


Neighbor 
192.168.20. 
192.168.20. 


192.168.20. 
192.168.20. 
192.168.20. 


00:00:44 
00:00:44 


Vv 
4 
4 
192.168.20. 4 3 0 
4 
4 
4 


* The printout is identical to a show ip bgp summary printout but 
displays only neighbors that are members of the specified peer 


group. 
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The show ip bgp peer-group peer-group-name summary command is used in this example to 
display only the summary status information about the neighbors who are members of the peer 


group wg_peers. 
Note The show ip bgp summary command is described in the module “BGP Overview.” 
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Monitoring Peer Groups (Cont.) 


router# show ip bgp neighbor 192.168.20.5 
BGP neighbor is 192.168.20.5, remote AS 5, external link 

Index 2, Offset 0, Mask 0x4 

wg_peers peer-group member 

BGP version 4, remote router ID 197.5.8.1 

BGP state = Established, table version = 54, up for 
00:00:14 

Last read 00:00:00, hold time is 180, keepalive interval is 
60 seconds 

Minimum time between advertisement runs is 5 seconds 

Received 50 messages, 0 notifications, 0 in queue 

Sent 80 messages, 0 notifications, 0 in queue 

Inbound path policy configured 

Incoming update network filter list is 6 

Outgoing update network filter list is 6 

Incoming update AS path filter list is 27 

Connections established 3; dropped 2 
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The show ip bgp neighbor command displays additional information about BGP neighbors 
that are members of a peer group. 


In the example here, the membership in the peer group wg_peers is indicated, in addition to 
other information as displayed by the command. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
pe =  eikcaem | | 


* Peer groups were introduced to ease the burden of 
configuring a large number of neighbors with 
identical or similar parameters. 


Peer groups are a fundamental BGP scalability tool 
and should be used in all environments where a 
router has a large number of BGP neighbors. 


Some peer group parameters can be overridden by 
neighbor configurations only if the individual 
configurations apply on incoming updates. 
Outgoing updates are always prepared for the peer 
group leader and then replicated to the other 
members of the peer group. 


Summary (Cont.) 


* Cisco IOS software optimizes the outgoing routes 
by running through the outgoing filters and route- 
maps only once and then replicating the results to 
each of the peer group members. 


* To configure BGP peer groups on Cisco IOS 
routers, create a BGP peer group, specify 
parameters for the BGP peer group, create a BGP 
neighbor, and then assign a neighbor into the peer 
group. 

* You can use the show ip bgp peer-group command to 
monitor information about BGP peer groups. 
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References 


For additional information, refer to these resources: 


m= For more information on BGP peer groups, refer to “BGP Peer Groups” at the following 
URL: http://www.cisco.com/warp/public/459/29.html 


m= For more information on configuring BGP peer groups, refer to “Configuring BGP” at the 
following URL: 
http://www.cisco.com/univercd/cc/td/doc/product/software/ios120/12cgcr/np1_c/1cprt1/1c 
bgp.htm#xtocid45 


Next Steps 
For the associated lab exercise, refer to the following section of the course Lab Guide: 


m Lab Exercise 7-2: Implementing BGP Peer Groups 
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Using BGP Route Dampening 


Overview 


BGP was designed to scale to meet the interdomain routing goals of large networks. To 
continue to scale to meet the growing routing requirements of the Internet, it is important that 
BGP processing overhead be reduced. Two factors that contribute most to BGP processing 
requirements are the addition or deletion of a prefix entry (in the BGP routing table) and the 
BGP route selection process. One way of reducing BGP processing requirements is to stabilize 
the state of the BGP routing table by reducing the number of routing table state changes that are 
propagated by BGP. 


Route dampening is a BGP feature that has been designed to reduce BGP processing 
requirements by minimizing the propagation of unstable routes to BGP peers. AS border 
routers, in any BGP implementation, cannot rely upon external peers to sufficiently shield the 
AS from routing table instability. Route dampening allows route instability to be contained at 
an AS border router that borders the instability. 


This lesson describes the purpose and operation of the route-dampening feature on Cisco IOS 
routers. Also discussed in this lesson are the Cisco IOS commands that are required to enable 
route dampening, modify default dampening parameters, and release a route that has been 
suppressed because of dampening. The Cisco IOS commands that are used to monitor route 
dampening are also discussed. 


Relevance 


Even when a BGP implementation is correctly configured and highly robust, the performance 
of the routing process on any given router is limited. Limiting the propagation of unstable 
routes, specifically when they are not beneficial to the network, becomes an important issue 
because it reduces the processing requirements of the router that is forced to process routing 
table state changes. Route dampening is an important scalability feature for BGP routers. 
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Objectives 


Upon completing this lesson, you will be able to describe the use of BPG route dampening. 
This includes being able to meet these objectives: 


m Describe the purpose of BGP route dampening 

m Describe the operation of BGP route dampening 

m Identify the Cisco IOS commands that are required to configure BGP route dampening 
m Identify the Cisco IOS commands that are required to release dampened routes 


m™ Identify the Cisco IOS commands that are required to monitor BGP route-dampening 
operation 


Learner Skills and Knowledge 
To benefit fully from this lesson, you must have these prerequisite skills and knowledge: 


m Successful completion of Building Scalable Cisco Internetworks (BSCI) or equivalent 


Outline 


The outline lists the topics included in this lesson. 


Outline 
ES 
° Overview 
° BGP Route Dampening 
* Route-Dampening Operation 
° Configuring BGP Route Dampening 


¢ Releasing Dampened Routes 


* Monitoring Route Dampening 
° Summary 
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BGP Route Dampening 


This topic describes the purpose of BGP route dampening. 


BGP Route Dampening 


* Designed to reduce router processing load 
caused by unstable routes. 


* Prevents sustained routing oscillations 
without affecting other well-behaved routes. 


° Defined in RFC 2439: BGP Route Flap 
Dampening. 


* Route dampening is a tool designed to help 
minimize the number of BGP updates. 


¢ Other update reduction tools include: 
—Batching of BGP updates 
—Per-neighbor update timers 


BGP is the only routing protocol that is designed for large internetworks with the specific 
intention of carrying a large number of prefixes. There are several mechanisms that are built 
into BGP that ensure maximum router stability. 


For example, a BGP router does not forward BGP routing updates immediately after receiving 
them. Every time a BGP router sends an update, it starts a 5-sec timer for internal neighbors 
and a 30-sec timer for external neighbors. No new updates can be sent until that timer expires. 
The result is that if a router contains a link that is flapping repeatedly (available, then 
unavailable, then available, then unavailable, and so on) at a rate of once per second, external 
routers see the flap at a much slower rate. Routers that are external to the source of the flap are 
not forced to recalculate the best path every second but, at most, every 30 sec. 


Reducing the rate at which neighboring routers process flapping routes assists in reducing the 
requirements to process the BGP update. However, routers that process routing updates for 
unstable routes are still wasting resources in determining the best route to the destination. 
Because the unstable route is oscillating between up and down, each route update that a router 
receives causes it to process the unstable route all over again. A better approach is to remove 
the update about the route until it can be guaranteed that the destination is more stable. 


With this goal in mind, an additional BGP scalability mechanism called route flap dampening 
was created to reduce route update processing requirements by suppressing unstable routes. 
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BGP Route Dampening (Cont.) 


¢ Minimizes the amount of BGP update 
processing in the Internet by suppressing 
unstable (flapping) routes 


° Does not suppress routes that occasionally 
flap 


¢ Suppresses routes that are likely to flap in the 
future based on the history of their behavior 


—Flap = removal of route 
— Suppress = do not use a route after it reappears 


Most service providers hold routing information for the entire Internet. Therefore, a flapping 
link somewhere in the Internet can cause all routers in the Internet to keep processing changes 
because of one single link. If, however, one of the autonomous systems in the Internet 
implements route dampening, the flapping network is suppressed. The route is not propagated 
further to other autonomous systems until the configured rules of route dampening allow it. 


A “flap” refers to a route that is repeatedly available, then unavailable, then available, then 
unavailable, and so on. If a route flaps once or twice, it is typically not considered a flap from 
an administrative perspective. If the flapping happens more often, however, there is probably 
something wrong with the destination and it should be suppressed. The BGP router stores a 
suppressed route in the BGP table but does not consider it in the BGP path selection process 
and does not therefore propagate it to other BGP neighbors or use it for data forwarding. 
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Route-Dampening Operation 


This topic describes the operation of BGP route dampening. 


Route-Dampening Operation 


° Each time an EBGP route flaps, it gets 1,000 
penalty points (IBGP routes are not 
dampened). 


° The penalty placed on a route is decayed 
using the exponential decay algorithm. 


° When the penalty exceeds the “suppress 
limit,” the route is dampened (no longer used 
or propagated to other neighbors). 


° A dampened route is propagated when the 
penalty drops below the “reuse limit.” 


A BGP router with route dampening enabled keeps track of all routes (even those that are 
unreachable) so that it can recall the penalties that are assigned to each route. Every time a 
route flap occurs, the flapping route receives 1000 penalty points. The penalty is gradually 
decreased through the use of a decaying algorithm. If a route flaps several times, it will be 
penalized (gain enough penalty points) and subsequently reach and exceed the suppress limit. 


Any route that reaches the suppress limit is no longer forwarded to other neighbors until the 

assigned penalty is once again below the reuse limit. An exponential decay algorithm reduces 
penalty points that are applied to a flapping route. After the number of penalty points that are 
assigned to a route falls below the reuse limit, the BGP router once again advertises the route. 
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Route-Dampening Operation (Cont.) 


° Flap history is forgotten when the penalty 
drops below half of the “reuse limit.” 


¢ Aroute is never dampened for more time 
than the “maximum suppress limit.” 


¢ An unreachable route with a flap history is 
put in the “history state”—it stays in the 
BGP table but only to maintain the flap 
history. 


° A penalty is applied on the individual path 
in the BGP table, not on the IP prefix. 
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A router stops tracking penalty points once they are below half of the reuse limit. 


The maximum suppress limit defines the maximum duration that a route can be suppressed 
once it has been suppressed. 


After enabling route dampening, the router never removes a route from the BGP table. A route 
that has been withdrawn by a BGP neighbor can still be seen in the BGP table and is marked 
with an “h” (history state). 


A penalty is always applied to a path and not a prefix. If one of the paths is flapping, it does not 
mean that the destination is flapping. 
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Configuring BGP Route Dampening 


This topic identifies the Cisco IOS commands that are required to configure BGP route 
dampening. 


Configuring BGP Route Bampeniig 


router (config-router) # 


bgp dampening [half-life reuse suppress max- 
suppress-time] [route-map map-name] 


* Configures BGP route dampening 
* BGP dampening parameters: 


— half-life Decay time in which the penalty is halved 
— suppress Value when the route starts dampening 

— reuse Value when the dampened route is reused 
— max-suppress-time Maximum time to suppress the route 

— route-map Name of route-map controlling dampening 


BGP v3.1—7-7 


To enable route dampening, use the bgp dampening command. Optionally, you can change the 
default settings of the route-dampening parameters. 


Route flap dampening requires the following parameters: 


m half-life: The half-life is the time that is needed for the penalty to halve (default is 15 
minutes). 


™ suppress: When a route has more penalty points than the suppress limit, the route is 
suppressed (default is 2000). 


m reuse: After the flapping has stopped and the penalty for a route has fallen below the reuse 
limit, the route is unsuppressed (default is 750). 


™ = max-suppress-time: No route can be suppressed longer than the max-suppress-time minutes 
(default is 1 hour; maximum is 255 minutes). 


You can specify the four route flap dampening parameters directly with the bgp dampening 
command. Alternatively, you can create a route-map that specifies different dampening 
parameters for different sets of routes, and then you can apply the route-map with the bgp 
dampening route-map command. 
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Configuring BGP Route 
Dampening (Cont.) 


Most Internet service providers use default values: 
* A flapping route is dampened after three successive flaps. 
* A route stays suppressed for approximately 30 min. 


* Net result: Route is lost for 30 min if a BGP session with a 
neighbor is cleared three times in succession. 


Default dampening parameter values are: 

— half-life 15 min 

— suppress 2000 

— reuse 750 

— max-suppress-time 60 min (4x half-life) 

— per-flap penalty 1000 (nonconfigurable) 
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This sample calculation shows how long a route that flaps three times is suppressed with the 
default values of the Cisco IOS route-dampening parameters. Each time a route flaps, it 
accumulates another 1000 points. After the third flap, the route has almost 3000 points. 
Remember that the penalty is gradually decreased through the use of a decaying algorithm, 
causing a reduction in the number of points that the route accumulates. It takes 15 min for the 
penalty to drop below 1500 (provided there are no further flaps) and another 15 minutes to drop 
below the reuse limit of 750. 


Many service providers change the default parameters to allow a maximum suppress time of 
several hours. 


Note Using the clear ip bgp * command is regarded as a flap to neighboring autonomous 
systems. Using this command several times may cause neighboring autonomous systems to 
suppress prefixes for some time even if there is nothing wrong with the route. 


Note Using the clear ip bgp * [soft] [in | out] command is not regarded as a flap and should be 
used instead of clear ip bgp * for clearing the neighbor relationships. 


You can change all default values if you specify them in the optional parameters of the bgp 
dampening command. The per-flap penalty is the only value that is not configurable. 
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Configuring BGP Route 
Dampening (Cont.) 


router (config-route-map) # 


set dampening half-life reuse suppress max-suppress- 
time 


° Sets the BGP dampening parameters for individual 
routes matched by a route-map entry. 


° Apply this route-map to the bgp dampening command 
instead of specifying individual parameters. 


* Applications: 


— Less aggressive dampening of routes toward root DNS 
servers (or other servers) 


—Dampen smaller prefixes more aggressively 


— Selective dampening based on BGP neighbor and 
route-map match criteria 


Many service providers prefer to implement selective dampening. Larger prefixes are usually 
less likely to flap and should not be penalized as aggressively as smaller prefixes that populate 
the majority of the BGP table. 


You can use a route-map in combination with a prefix-list to match on prefix length and to set 
different route-dampening parameters for larger prefixes than for smaller ones. A practical 
service provider policy is to use a route-map to exclude root Domain Name System (DNS) 
servers from dampening altogether. 


You can then attach the route-map to the BGP route-dampening process with the bgp 
dampening route-map command. 
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Releasing Dampened Routes 


This topic identifies the Cisco IOS commands that are used to release dampened routes. 


Releasing Dampened Routes 


router# 


clear ip bgp ip-address flap-statistics [{regexp regexp} | 
{filter-list list-name} | {ip-address network-mask}] 


° Clears the flap statistics, but does not release 
dampened routes. 


router# 


clear ip bgp dampening [ip-address network-mask] 


* Releases all the dampened routes, or just the 
specified network. 


° Flap statistics or dampened routes are also cleared 
when the BGP session with the neighbor is lost. 


There are two timers that are calculated for every route when it flaps: 


= Time to forget: The time that it takes before all flap history is deleted. Using the clear ip 
bgp flap-statistics command deletes all penalty information, but it does not release the 
dampened paths. 


= Time to reuse: The time that it takes before a route can be considered for best-path 
processing. Using the clear ip bgp dampening command resets this timer for all networks 
or for specified networks so that they are no longer suppressed. The flap statistics, 
however, are still kept, and the next flap will cause the previously dampened paths to be 
suppressed again. 
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clear ip bgp flap-statistics 


To clear BGP flap statistics, use the clear ip bgp flap-statistics privileged EXEC command. 


= clear ip bgp ip-address flap-statistics [{regexp regexp} | {filter-list list-name} | {ip- 


address network-mask} | 


Syntax description 


Parameter 


ip-address 


Description 


(Optional) Clears flap statistics for a single entry at this IP 
address. If this argument is placed before flap-statistics, the 
router clears flap statistics for all paths from the neighbor at this 
address. 


regexp regexp 


(Optional) Clears flap statistics for all the paths that match the 
regular expression. 


filter-list list-name 


(Optional) Clears flap statistics for all the paths that pass the 
access-list. 


network-mask 


(Optional) Network mask that is applied to the ijp-address 
argument. 


clear ip bgp dampening 


To clear BGP route dampening information and unsuppress the suppressed routes, use the clear 
ip bgp dampening privileged EXEC command. 


= clear ip bgp dampening [ip-address network-mask] 


Syntax description 


Parameter 


ip-address 


Description 


(Optional) Clears flap statistics for a single entry at this IP 
address. If this argument is placed before flap-statistics, the 
router clears flap statistics for all paths from the neighbor at this 
address. 


network-mask 


(Optional) Network mask that is applied to the jp-address 
argument. 
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Monitoring Route Dampening 


This topic identifies the Cisco IOS commands that are required to monitor BGP route 
dampening. 


Monitoring Route Dampening 


router> 


show ip bgp dampened-paths 


* Displays the dampened routes 


router> 


show ip bgp flap-statistics [{regexp regexp} | {filter- 
list access-list} | {ip-address mask [longer-prefix] }] 


° Displays flap statistics for all routes with dampening 
history 

¢ Can match routes against regular expressions, AS-path 
access-lists, a specific route, or more specific routes 


router# 


debug ip bgp dampening 


° Displays the BGP dampening events 
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The penalty that is placed on a network is decayed until the reuse limit is reached, upon which 
the route is once again advertised. Every time that a route flap occurs, the penalty is 
recalculated. In the router, the penalty is encoded as the time that it takes for the penalty to 
decay below the reuse limit. At half of the reuse limit, the dampening information for the route 
to the network is removed. 


Use the show ip bgp dampened-paths command to list all routes that are currently suppressed 
because of dampening. 


Use the show ip bgp flap-statistics command to list all routes that have a penalty still above 
the time-to-forget limit. You can also use this command in combination with regular 
expressions and filter-lists. 


The show ip bgp flap-statistics prefix command displays detailed dampening information 
about a specific network. 


The show ip bgp flap-statistics prefix mask longer-prefix command displays dampening 
information about a specific network and its subnets. 


Use the debug ip bgp dampening command to display BGP dampening events as they occur 
in real time. 
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Example 


Monitoring Route Dampening— 
Example 


Penalty (in thousands) 


3 


Suppress limit 


The route is lost and 
enters history state 


Flap history forgotten 
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The example here shows how, after the first flap (a route becomes unreachable), the router 
withdraws the route but keeps it in its own database to keep track of the penalty. The route 
enters the history state. 
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Monitoring Route Dampening— 
Example (Cont.) 


The route is gone, but the history 
Sntak entry is retained in the BGP table 


BGP: charge penalty for 12.0.0.0/8 path 387 462 with 
halflife-time 15 reuse/suppress 750/2000 
BGP: flapped 1 times since 00:00:00. New penalty is 1000 


router# show ip bgp 12.0.0.0 
BGP routing table entry for 12.0.0.0/8, version 7 
Paths: (2 available, best #2, advertised over EBGP) 
387 462 (history entry) 
1.3.0.3 from 1.3.0.3 (14.1.2.3) 
Origin IGP, localpref 90, external 
Dampinfo: penalty 992, flapped 1 times in 00:00:10 
462 
1.1.0.4 (metric 41024000) from 1.0.0.1 (11.0.0.1) 
Origin IGP, metric 0, localpref 100, valid, internal, best 


dampening information 
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Using show ip bgp displays suppressed prefixes with the state “h.” 
Using show ip bgp prefix displays suppressed prefixes that are marked with “history entry.” 


If a prefix is in the history state, it means that it is currently unreachable but the information has 
been kept in the BGP table to keep track of the penalty. 
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Monitoring Route Dampening— 
Example (Cont.) 


Penalty (in thousands) 


3 


Penalty goes over suppress 
limit after several flaps 


Suppress limit 
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The example here shows how after the third flap, the penalty of the route exceeds the suppress 
limit, and the route could be suppressed. When the route exceeds the suppress limit, one of two 
things could happen: 


m= The router will put the route in the history state if the route is currently unreachable. 


m= The router will suppress the route if the route is currently reachable. 
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Monitoring Route Dampening— 
Example (Cont.) 


Route flaps, penalty goes 
over suppress limit 
router# 


BGP: charge penalty for 12.0.0.0/8 path 387 462 with 
halflife-time 15 reuse/suppress 750/2000 
BGP: flapped 2 times since 00:05:37. New penalty is 1776 


router# 

BGP: charge penalty for 12.0.0.0/8 path 387 462 with 
halflife-time 15 reuse/suppress 750/2000 

BGP: flapped 3 times since 00:06:54. New penalty is 2681 


router# 


BGP: suppress 12.0.0.0/8 path 387 462 for 00:27:00 (penalty 2629) 
halflife-time 15, reuse/suppress 750/2000 


Route is damped after it 
reappears in the BGP table 


002G_282 
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The figure here displays the debugging messages that accompany the three route flaps that were 
illustrated in the previous figure. After the 12.0.0.0/8 prefix flaps for the third time, the router 
assigns a new penalty of 2681 to the route. Because the new penalty exceeds the suppress limit 
of 2000, the 12.0.0.0/8 prefix is suppressed by the router for 27 min (if it remains stable). 


Using show ip bgp displays all suppressed prefixes that have their state marked as dampened 


(“d”). 
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Monitoring Route Dampening— 
Example (Cont.) 


router# show ip bgp dampened-paths 

BGP table version is 20, local router ID is 10.1.1.1 

Status codes: s suppressed, d damped, h history, * valid, > best 
Origin codes: i - IGP, e - EGP, ? - incomplete 


Network From Reuse Path 
*d 12.0.0.0 23.0.3 00:23:5 387 462 i 


router# show ip bgp 12.0.0.0 

BGP routing table entry for 12.0.0.0/8, version 7 

Paths: (2 available, best #2, advertised over EBGP) 

387 462, (suppressed due to dampening) 

2oa0.3 ftom -1.3.70.3 (1451.2. 3) 
Origin IGP, localpref 90, valid, external 
Dampinfo: penalty 2278, flapped 3 times in 00:10:32, 
reuse in 00:24:00 


-1.0.4 (metric 41024000) from 1.0.0.1 (11.0.0.1) 
Origin IGP, metric 0, localpref 100, valid, internal, best 


The route is available, but not used 
or propagated to other neighbors 


Systems, Inc. All rights reserved. BGP v3.1—7-16 


The show ip bgp dampened-paths command is used to list all networks that are currently 


suppressed because of dampening. 


The show ip bgp prefix command will display detailed information among other paths about 
suppressed prefixes. These prefixes are marked with the words “suppressed due to dampening.” 
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Monitoring Route Dampening— 
Example (Cont.) 


Penalty (in thousands) 
Penalty goes below suppress limit 


but not below reuse limit 


Another flap increases penalty 


Suppress limit 
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The penalty of the route is decreased following an exponential curve. After a while, the penalty 
drops below the suppress limit, but the route is not yet released—the route is released only after 
the penalty drops further below the reuse limit. In the example here, the route flaps again, 
further increasing the penalty. 


Monitoring Route Dampening— 
Example (Cont.) 


Penalty (in thousands) 


3 


Route is released after its 
penalty drops below reuse limit 


Flap history forgotten 
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In the example here, the route has stabilized, and the penalty gradually drops below the reuse 
limit. At that point in time, the BGP router releases the route, and it can now be selected as the 
best BGP path. If the released route is selected by the router as the best BGP path, it is also 
propagated to BGP neighbors and used for data forwarding. 
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Monitoring Route Dampening— 
Example (Cont.) 


Penalty (in thousands) 


3 


Flap history is forgotten after the penalty 
drops below half of the reuse limit 


Flap history forgotten 
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When the penalty that is associated with a route drops below half of the reuse limit, the penalty 
and the flap history that are associated with the route are cleared by the router. 
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Summary 


This topic summarizes the key points discussed in this lesson. 


Summary 
isc cor 


Route dampening is a BGP feature that is designed to 
reduce BGP processing requirements by minimizing the 
propagation of unstable routes to BGP peers. 


A router with route dampening enabled keeps track of all 
routes and the penalties that are assigned to them. Each 
time a flap occurs, the flapping route receives 1000 penalty 
points. If the route penalties reach the suppress limit, the 
route is no longer forwarded to other neighbors until the 
assigned penalty has decayed below the reuse limit. 


You can implement route dampening with the bgp 
dampening command either globally in the BGP process or 
selectively using a route-map. 


The clear ip bgp dampening command clears dampening 
information and releases suppressed routes. 


You can use the show ip bgp flap-statistics command to 
successfully monitor the operation of route dampening. 


References 


For additional information, refer to these resources: 


m= For more information on BGP route dampening and its function, refer to “BGP Case 
Studies 4” at the following URL: 
http://www.cisco.com/warp/public/459/bgp-toc.html#flapdampen 


m= For more information on configuring BGP route dampening, refer to “Configuring BGP” at 
the following URL: 
http://www.cisco.com/univercd/cc/td/doc/product/software/ios121/121cgcr/ip_c/ipcprt2/1c 
dbgp.htm#xtocid61 


Next Steps 


For the associated lab exercise, refer to the following section of the course Lab Guide: 


m Lab Exercise 7-3: Using BGP Route Dampening 
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Lesson Assessments 


Overview 


Use the lesson assessments here to test what you learned in this module. The correct answers 
and solutions are found in the Lesson Assessment Answer Key. 


Outline 
This section includes these assessments: 
@ Quiz 7-1: Improving BGP Convergence 
@ Quiz 7-2: Limiting the Number of Prefixes Received from a BGP Neighbor 
= Quiz 7-3: Implementing BGP Peer Groups 
m Quiz 7-4: Using BGP Route Dampening 
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Quiz 7-1: Improving BGP Convergence 


Complete this quiz to assess what you learned in the lesson. 


Objectives 
This assessment tests your knowledge of how to: 
m Describe convergence in BGP networks 
m™ Describe the function of BGP router processes 
m Describe the effects of BGP processes on router CPU resources 
m Identify Cisco IOS performance improvements to reduce BGP convergence time 


m Identify the Cisco IOS commands that are required to configure and monitor path MTU 
discovery 


m= Identify the Cisco IOS commands that are required to configure and monitor the input 
queue depth on a router interface 


m™ Identify the Cisco IOS commands that are required to configure and monitor BGP scan 
time 


m Identify the Cisco IOS commands that are required to configure and monitor the BGP 
advertisement interval 


Quiz 
Answer these questions: 


Q1) ~~ ~What are three characteristics of a converged BGP network? (Choose three.) 


A) The input queue and output queue for all peers is 0. 
B) All routes in the BGP table have been installed in the routing table. 
C) The table version for all peers equals the table version of the BGP table. 


D) All routes have been accepted. 


Q2) Which two of the following modifications result in improved BGP convergence? 
(Choose two.) 


A) increasing the default value of BGP hold time 


B) lowering the default value of BGP scan time 
C) increasing the default value of the neighbor advertisement intervals 
D) lowering the default value of the neighbor advertisement intervals 


Q3) What is the main task of the BGP scanner process? 
A) sends routing updates to BGP neighbors 


B) walks the BGP table for routes to enter into the IP routing table 
C) confirms the reachability of BGP next hops 
D) scans the router configuration to establish and maintain BGP neighbors 
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Q4) = One of your BGP core routers is experiencing periodic slow responses to ping packets 
that are being directed to it from the network management console. The router has just 
been configured to receive full Internet routes, and you suspect that the BGP router 
process is causing CPU utilization issues in the core router. Which two router 
commands should you use to confirm your suspicion? (Choose two.) 


A) show ip route 

B) show ip bgp summary 
C) show process cpu 

D) show memory 


Q5) — The output of a show interfaces fastethernet 0/0 command follows: 


Fast EthernetO is up, line protocol is up 

Hardware is DEC21140, address is 0000.0c0c.1111 (bia 
0002.eaa3.5a60) 

Internet address is 112.64.101.17 255.255.255.240 

MTU 1460 bytes, BW 100000 Kbit, DLY 100 usec, rely 255/255, 
load 200/255 

Encapsulation ARPA, loopback not set, keepalive not set, 
hdx, 100BaseTX 

ARP type: ARPA, ARP Timeout 4:00:00 

Last input never, output 0:00:16, output hang 0:28:01 

Last clearing of "Show interface" counters 0:20:05 

Output queue 25/40, 0 drops; input queue 50/500, 1470 drops 

5 minute input rate 21666400 bits/sec, 1855 packets/sec 

5 minute output rate 72221 bits/sec, 618 packets/sec 


Q6) How has the interface been modified to improve BGP convergence? 


A) The output queue has been decreased to expedite packet forwarding out the fast 
Ethernet interface. 

B) The drop threshold of the input queue has been set to begin randomly 
discarding packets after the queue reaches 50 packets deep. 

C) PMTU discovery has been enabled by setting the interface MSS to 1460 bytes. 

D) The size of the input queue has been increased to support up to 500 incoming 
packets. 


Q7) _ Refer to the following Cisco IOS router output: 


router# show ip bgp summary 

BGP router identifier 172.16.0.4, local AS number 1 

BGP table version is 16, main routing table version 16 

20 network entries and 20 paths using 2826 bytes of memory 

8 BGP path attribute entries using 480 bytes of memory 

7 BGP AS-PATH entries using 168 bytes of memory 

3 BGP community entries using 72 bytes of memory 

0 BGP route-map cache entries using 0 bytes of memory 

3 BGP filter-list cache entries using 36 bytes of memory 

BGP activity 20/0 prefixes, 24/4 paths, scan interval 120 secs 


Neighbor Vv AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd 
172.16.0.1 4 li 30 30 16 0 0 00:23:13 5 
172.16.0.2 4 1 33 30 16 0 0 00:23:15 5 
LIZ: 165-0353 4 al. 27 30 16 0 0 00:23:14 5 
192.168.21.99 4 99 31 35 16 0 0 00:23:04 5 


Q8) Which two parameters would indicate that the BGP network has converged? (Choose 
two.) 


A) The TblVer for all neighbors is 16. 

B) V is set to 4 for all neighbors. 

C) The InQ and OutQ for all neighbors is 0. 

D) All neighbors are in the Established state and have the same PfxRcd value. 
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Q9) Using the command output from question 6, identify how frequently the BGP scanner 
process will run on the router. 


A) By default, the process will run every 60 sec. 

B) The process has run 16 times and will run again when the next BGP update 
arrives. 

C) The process will run on this router every 120 sec. 

D) It cannot be determined from this output. 


Q10) What are two potential issues that are caused by modifying the default scan time and 
advertisement interval on a BGP router? (Choose two.) 


A) Router CPU resources can be exhausted. 
B) Router memory resources can be depleted. 
C) Routing loops are more likely. 


D) BGP could converge faster than the IGP and cause network black holes. 


Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 7-2: Limiting the Number of Prefixes 
Received from a BGP Neighbor 


Complete this quiz to assess what you learned in the lesson. 


Objectives 
This assessment tests your knowledge of how to: 
m Describe the need for limiting the number of routes that are received from a BGP neighbor 


m Identify the Cisco IOS command that is required to configure the BGP maximum-prefix 
function 


m Identify the Cisco IOS command that is required to monitor the BGP maximum-prefix 
function 


Quiz 
Answer these questions: 


Q1) ~~ What are three reasons to limit the number of BGP prefixes that are received from a 
neighbor? (Choose three.) 


A) to prevent denial-of-service attacks 

B) to protect against incorrect router configuration on the neighbor side 

C) to prevent redundant routing information from being loaded into the BGP table 
D) to avoid overloading router memory and CPU resources 


Q2) In which two situations would a directly connected BGP neighbor stay in the Idle state? 
(Choose two.) 


A) The neighbor has exceeded the maximum number of allowed prefixes. 
B) The maximum-prefix threshold has been reached. 
C) The restart option has not been specified with the 
maximum-prefix command. 
D) The neighbor is more than one hop away. 
Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 7-3: Implementing BGP Peer Groups 


Complete this quiz to assess what you learned in the lesson. 


Objectives 
This assessment tests your knowledge of how to: 
m Describe the need for BGP peer groups 
m Describe the performance benefits of using BGP peer groups 
m= Describe the limitations of BGP peer groups 
m™ Describe the implementation of BGP peer groups in Cisco IOS software 
m™ Identify the Cisco IOS commands that are required to configure BGP peer groups 


m Identify the Cisco IOS commands that are required to monitor the operation of BGP peer 
groups 


Quiz 
Answer these questions: 


Q1) What is the purpose of using BGP peer groups? 


A) BGP peer groups can be used to configure the same set of parameters for a 
number of BGP neighbors in a common template. 
B) BGP peer groups can be used to allow anonymous BGP neighbors. 


C) BGP peer groups allow EBGP peers to be configured with the same AS 
number and parameters. 

D) BGP peer groups can be used to hide the identity of BGP peers from external 
neighbors. 


Q2) — What are two limitations of BGP peer groups on Cisco routers? (Choose two.) 
A) EBGP and IBGP neighbors cannot be members of the same peer group. 


B) All routers in the peer group must belong to the same AS. 
C) Peer group members cannot contain different outbound filtering mechanisms. 
D) Peer group members must have the same inbound filtering mechanisms. 


Q3) What are three steps that are required to properly configure BGP peer groups on Cisco 
routers? (Choose three.) 


A) specify parameters for the BGP peer group 

B) create a BGP peer group 

C) enable the peer group by clearing the BGP session 
D) assign a neighbor into the peer group 


Q4) = Which command do you use to display the summary status of all neighbors in a peer 
group? 
A) show ip bgp 
B) show peer-group summary 
C) show ip bgp neighbor 
D) show ip bgp peer-group summary 
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Scoring 


You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Quiz 7-4: Using BGP Route Dampening 


Complete this quiz to assess what you learned in the lesson. 


Objectives 
This assessment tests your knowledge of how to: 
m Describe the purpose of BGP route dampening 
m Describe the operation of BGP route dampening 
m Identify the Cisco IOS commands that are required to configure BGP route dampening 
m Identify the Cisco IOS commands that are required to release dampened routes 


m Identify the Cisco IOS commands that are required to monitor BGP route-dampening 
operation 


Quiz 
Answer these questions: 


Q1) ~~ Which two mechanisms are built into BGP to make it more scalable by reducing the 
route-processing requirements of BGP routers? (Choose two.) 


A) split horizon 


B) route dampening 
C) synchronization 
D) per-neighbor update timers 


Q2) What are two things that happen to an EBGP route that has become unreachable when 
BGP route dampening is used? (Choose two.) 


A) It is removed from the IP routing table. 
B) It is removed from the BGP table. 
C) It will remain in the IP routing table as long as its penalty remains greater than 


50 percent of the reuse limit. 
D) It is kept in the BGP table and marked as a history entry. 


Q3) What are two methods of enabling route dampening on a Cisco router? (Choose two.) 


A) globally, by enabling route dampening in global router configuration mode 

B) globally, by enabling route dampening under the BGP routing process 

C) on specific routes by enabling route dampening on a specific interface 

D) by using a route-map in the BGP process to apply route dampening to specific 
routes. 


Q4) — Which two things could happen to a BGP route that is penalized above the reuse limit, 
but its assigned penalty is under the suppress limit? (Choose two.) 


A) The route is suppressed from BGP updates if it is reachable. 
B) The route is marked as a history entry in the BGP table. 


C) The route is withdrawn from the IP routing table. 
D) The route will continue to be advertised. 
Scoring 
You have successfully completed the quiz for this lesson when you earn a score of 80 percent 
or better. 
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Lesson Assessment Answer Key 


Quiz 7-1: Improving BGP Convergence 
Ql) so GD 


Q2) B, D 
Q3) Cc 
Q4) Bec 
Q5) D 
Q6) AC 
Q7) C 
Q8) A,B 


Quiz 7-2: Limiting the Number of Prefixes Received from a BGP Neighbor 
Ql) A B,D 
Q2) AC 


Quiz 7-3: Implementing BGP Peer Groups 


Ql) A 

Q2) AC 
Q3) A,B,D 
Q4) D 


Quiz 7-4: Using BGP Route Dampening 


Ql) B, D 
Q2) A,D 
Q3) B, D 
Q4) B,C 
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